Sep 01 01:31:34 devstack cinder-volume[76225]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:31:34 devstack cinder-volume[76225]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:31:34 devstack cinder-volume[76225]: we strongly recommend against using it for new projects. Sep 01 01:31:34 devstack cinder-volume[76225]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:31:34 devstack cinder-volume[76225]: framework. For more detail see Sep 01 01:31:34 devstack cinder-volume[76225]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:31:34 devstack cinder-volume[76225]: import eventlet # noqa Sep 01 01:31:36 devstack cinder-volume[76225]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:31:36 devstack cinder-volume[76225]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:31:36 devstack cinder-volume[76225]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:31:37 devstack cinder-volume[76225]: INFO dbcounter [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Registered counter for database cinder Sep 01 01:31:37 devstack cinder-volume[76225]: DEBUG oslo_db.sqlalchemy.engines [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG dbcounter [-] [76225] Writer thread running {{(pid=76225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:31:38 devstack cinder-volume[76225]: INFO cinder.rpc [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:31:38 devstack cinder-volume[76225]: INFO cinder.rpc [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_db.sqlalchemy.engines [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:31:38 devstack cinder-volume[76225]: INFO cinder.volume.manager [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Determined volume DB was empty at startup. Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG cinder.volume.manager [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76225) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:31:38 devstack cinder-volume[76225]: INFO cinder.volume.manager [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:31:38 devstack cinder-volume[76225]: WARNING stevedore.named [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:31:38 devstack cinder-volume[76225]: WARNING castellan.key_manager [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:31:38 devstack cinder-volume[76225]: WARNING cinder.keymgr.conf_key_mgr [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG cinder.volume.drivers.lvm [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76225) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_concurrency.processutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_concurrency.processutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.451s {{(pid=76225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_db.sqlalchemy.engines [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:31:38 devstack cinder-volume[76225]: INFO cinder.rpc [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 01:31:38 devstack cinder-volume[76225]: INFO cinder.rpc [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 01:31:38 devstack cinder-volume[76225]: WARNING stevedore.named [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:31:38 devstack cinder-volume[76225]: WARNING castellan.key_manager [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:31:38 devstack cinder-volume[76225]: INFO cinder.volume.manager [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_db.sqlalchemy.engines [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:31:38 devstack cinder-volume[76225]: INFO oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Starting 1 workers Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Started child 76388 {{(pid=76225) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Full set of CONF: {{(pid=76225) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] ******************************************************************************** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Configuration options gathered from: {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] ================================================================================ {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:31:38 devstack cinder-volume[76388]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] allow_availability_zone_fallback = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] allow_compression_on_image_upload = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] allowed_direct_url_schemes = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] api_rate_limit = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] auth_strategy = keystone {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] az_cache_duration = 3600 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_availability_zone = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_host = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_stats_polling_interval = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backup_api_class = cinder.backup.api.API {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backup_name_template = backup-%s {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backup_use_same_host = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backup_use_temp_snapshot = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] chap_password = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] chap_username = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_internal_tenant_project_id = 6697ea0f57a9409783600d04cbaa09d3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_internal_tenant_user_id = 22985405dde14ed39e64f137884bedcd {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cloned_volume_same_az = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cluster = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] compression_format = gzip {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] compute_api_class = cinder.compute.nova.API {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] config_dir = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] config_source = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] control_exchange = openstack {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] debug = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] default_availability_zone = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] default_group_type = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] default_volume_type = lvmdriver-1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] disk_geometry = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] driver_client_cert = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] driver_client_cert_key = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] driver_data_namespace = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] driver_ssl_cert_path = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] driver_ssl_cert_verify = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] driver_use_ssl = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] enable_force_upload = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] enable_new_services = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] enable_unsupported_driver = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] enforce_multipath_for_image_xfer = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:38 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] filter_function = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_api_insecure = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_api_servers = ['http://192.168.122.53/image'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_api_ssl_compression = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_ca_certificates_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_catalog_info = image:glance:publicURL {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_num_retries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance_request_timeout = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] goodness_function = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] graceful_shutdown_timeout = 5 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] group_api_class = cinder.group.api.API {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] host = devstack {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_compress_on_upload = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_conversion_address_space_limit = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_conversion_cpu_limit = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_conversion_disable = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_upload_use_cinder_backend = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_upload_use_internal_tenant = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_volume_cache_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_volume_cache_max_count = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] image_volume_cache_max_size_gb = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] init_host_max_objects_retrieval = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] instance_format = [instance: %(uuid)s] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] iscsi_target_flags = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] iscsi_write_cache = on {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] iser_helper = tgtadm {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76388]: INFO cinder.volume.manager [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] iser_ip_address = 192.168.122.53 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] iser_port = 3260 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_color = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_config_append = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_dir = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_options = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_rotate_interval = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_rotate_interval_type = days {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] log_rotation_type = none {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] max_age = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] max_logfile_count = 30 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] max_logfile_size_mb = 200 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] max_over_subscription_ratio = 20.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] message_reap_interval = 86400 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] message_ttl = 2592000 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] migration_create_volume_timeout_secs = 300 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] monkey_patch = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] monkey_patch_modules = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] my_ip = 192.168.122.53 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] no_snapshot_gb_quota = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] num_iser_scan_tries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] num_shell_tries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] num_volume_device_scan_tries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] nvmeof_conn_info_version = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] nvmet_ns_id = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] nvmet_port_id = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] osapi_max_limit = 1000 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] osapi_volume_ext_list = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] osapi_volume_listen_port = 8776 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] osapi_volume_use_ssl = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] osapi_volume_workers = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] per_volume_size_limit = -1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] periodic_fuzzy_delay = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] periodic_interval = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] public_endpoint = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] publish_errors = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] quota_backup_gigabytes = 1000 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] quota_backups = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] quota_gigabytes = 1000 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] quota_groups = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] quota_snapshots = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] quota_volumes = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] rate_limit_burst = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] rate_limit_except_level = CRITICAL {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] rate_limit_interval = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] reinit_driver_count = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] replication_device = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] report_discard_supported = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] report_interval = 120 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] reservation_clean_interval = 86400 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] reservation_expire = 86400 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] reserved_image_namespaces = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] reserved_percentage = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] rpc_response_timeout = 120 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] run_external_periodic_tasks = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] scst_target_driver = iscsi {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] scst_target_iqn_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_down_time = 720 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] shell_completion = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] snapshot_name_template = snapshot-%s {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] snapshot_same_host = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] split_loggers = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] state_path = /opt/stack/data/cinder {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] storage_availability_zone = nova {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] storage_protocol = iSCSI {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] syslog_log_facility = LOG_USER {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] target_helper = lioadm {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] target_ip_address = 192.168.122.53 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] target_port = 3260 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] target_protocol = iscsi {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] target_secondary_ip_addresses = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] trace_flags = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] transport_url = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] until_refresh = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] use_chap_auth = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] use_default_quota_class = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] use_journal = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] use_json = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] use_multipath_for_image_xfer = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] use_stderr = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] use_syslog = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] verify_glance_signatures = enabled {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_api_class = cinder.volume.api.API {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_backend_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_clear = zero {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_clear_ionice = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_clear_size = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_copy_bps_limit = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_dd_blocksize = 1M {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_name_template = volume-%s {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_service_inithost_offload = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volume_usage_audit_period = month {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] zoning_mode = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_concurrency.disable_process_locking = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.auth_section = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.auth_type = password {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.auth_version = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.cache = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.include_service_catalog = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.insecure = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.interface = public {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_password = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcache_username = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.region_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.service_type = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.backend = dogpile.cache.null {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.backend_argument = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.backend_expiration_time = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.config_prefix = cache.oslo {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.debug_cache_backend = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.enable_retry_client = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.enable_socket_keepalive = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.expiration_time = 600 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.hashclient_retry_attempts = 2 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.memcache_dead_retry = 300 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.memcache_pool_maxsize = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.memcache_sasl_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.password = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.proxies = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.redis_db = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.redis_server = localhost:6379 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.retry_attempts = 2 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.retry_delay = 0.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.socket_keepalive_count = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.socket_keepalive_idle = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.socket_keepalive_interval = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.socket_timeout = 1.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.tls_allowed_ciphers = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.tls_cafile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.tls_certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.tls_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.tls_keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cache.username = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] coordination.backend_url = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.asyncio_connection = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.asyncio_slave_connection = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.backend = sqlalchemy {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.connection = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.connection_debug = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.connection_parameters = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.connection_recycle_time = 3600 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.connection_trace = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.db_inc_retry_interval = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.db_max_retries = 20 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.db_max_retry_interval = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.db_retry_interval = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.max_overflow = 50 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.max_pool_size = 5 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.max_retries = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.mysql_wsrep_sync_wait = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.pool_timeout = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.retry_interval = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.slave_connection = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.sqlite_synchronous = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.synchronous_reader = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] database.use_db_reconnect = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_tracing.insecure = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.connection_string = messaging:// {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.es_doc_type = notification {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.es_scroll_size = 10000 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.es_scroll_time = 2m {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.filter_error_trace = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.hmac_keys = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.sentinel_service_name = mymaster {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.socket_timeout = 0.1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.trace_requests = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler.trace_sqlalchemy = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler_jaeger.process_tags = {} {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler_jaeger.service_name_prefix = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] profiler_otlp.service_name_prefix = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.enforce_new_defaults = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.policy_default_rule = default {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.policy_file = policy.yaml {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] privsep_osbrick.group = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] privsep_osbrick.helper_command = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] privsep_osbrick.user = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_sys_admin.group = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_sys_admin.helper_command = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] cinder_sys_admin.user = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.auth_section = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.auth_type = password {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.cafile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.collect_timing = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.insecure = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.send_service_user_token = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.split_loggers = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] service_user.timeout = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.auth_section = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.auth_type = password {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.collect_timing = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.insecure = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.region_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.split_loggers = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] glance.timeout = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.backend_availability_zone = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.chap_password = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.chap_username = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.disk_geometry = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.driver_client_cert = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.driver_client_cert_key = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.driver_data_namespace = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.driver_use_ssl = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.extra_capabilities = {} {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.filter_function = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.goodness_function = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.iscsi_target_flags = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.iscsi_write_cache = on {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.iser_helper = tgtadm {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.iser_port = 3260 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack sudo[76392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 01:31:39 devstack sudo[76392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.lvm_share_target = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.lvm_type = auto {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.num_shell_tries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.replication_device = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.report_discard_supported = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.reserved_percentage = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.target_helper = tgtadm {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.target_port = 3260 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.target_protocol = iscsi {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.trace_flags = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.unique_fqdn_network = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.use_chap_auth = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_backend_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_clear = zero {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_clear_ionice = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_clear_size = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_reports.file_event_handler = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_reports.log_dir = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.backend_host = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.chap_password = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.chap_username = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.disk_geometry = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.driver_client_cert = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.extra_capabilities = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.filter_function = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.goodness_function = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.iser_helper = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.iser_ip_address = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.iser_port = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.lvm_share_target = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.lvm_type = auto {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.num_shell_tries = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.replication_device = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.report_discard_supported = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.reserved_percentage = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.scst_target_driver = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.storage_protocol = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.target_helper = lioadm {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.target_ip_address = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.target_port = 3260 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.trace_flags = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.use_chap_auth = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_clear = zero {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_clear_size = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] lvmdriver-1.volumes_dir = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.ssl = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_notifications.driver = [] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_notifications.retry = -1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] key_manager.fixed_key = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.barbican_api_version = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.barbican_endpoint = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.barbican_endpoint_type = public {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.barbican_region_name = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.cafile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.collect_timing = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.insecure = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.number_of_retries = 60 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.retry_delay = 1 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.send_service_user_token = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.split_loggers = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.timeout = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.verify_ssl = True {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican.verify_ssl_path = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.auth_section = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.auth_type = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.cafile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.certfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.collect_timing = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.insecure = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.keyfile = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.split_loggers = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] barbican_service_user.timeout = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.approle_role_id = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.approle_secret_id = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.auth_method = approle {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.auth_path = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.kv_mountpoint = secret {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.kv_path = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.kv_version = 2 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.namespace = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.root_token_id = **** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.ssl_ca_crt_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.timeout = 60.0 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.token_file = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.token_role = None {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.use_ssl = False {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:31:39 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] ******************************************************************************** {{(pid=76225) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:31:39 devstack sudo[76392]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:39 devstack sudo[76503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:39 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:39 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.277s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:31:39 devstack cinder-volume[76388]: INFO cinder.brick.local_dev.lvm [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:39 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:39 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:31:39 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:40 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:40 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:40 devstack cinder-volume[76388]: DEBUG cinder.brick.local_dev.lvm [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76388) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 01:31:40 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:40 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:40 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:40 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:40 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.791s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:40 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:40 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:40 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:40 devstack sudo[76993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:40 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:41 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:41 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 01:31:41 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:41 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.339s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:41 devstack sudo[77088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:31:41 devstack sudo[77088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:41 devstack sudo[77088]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:41 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:41 devstack sudo[77096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:31:41 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:42 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:42 devstack sudo[77180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:31:42 devstack sudo[77180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:42 devstack sudo[77180]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:42 devstack sudo[77183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:42 devstack sudo[77183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:42 devstack sudo[77183]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:42 devstack sudo[77187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:42 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:42 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:42 devstack cinder-volume[76388]: INFO cinder.volume.drivers.lvm [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:42 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:43 devstack sudo[77191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:43 devstack sudo[77191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:43 devstack sudo[77191]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:43 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:43 devstack cinder-volume[76388]: DEBUG cinder.volume.drivers.lvm [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Updating volume stats {{(pid=76388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:31:43 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:43 devstack sudo[77195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:31:43 devstack sudo[77195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:43 devstack sudo[77195]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:43 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:43 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:43 devstack sudo[77198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:31:43 devstack sudo[77198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:43 devstack sudo[77198]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:43 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:43 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:43 devstack sudo[77201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:43 devstack sudo[77201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:44 devstack sudo[77201]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:44 devstack sudo[77204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:31:44 devstack sudo[77204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:44 devstack sudo[77204]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:44 devstack cinder-volume[76388]: INFO cinder.volume.driver [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG cinder.volume.driver [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76388) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG oslo_db.sqlalchemy.engines [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG dbcounter [-] [76388] Writer thread running {{(pid=76388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG cinder.db.api [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Building query based on filter {{(pid=76388) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG cinder.image.image_utils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76388) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:31:44 devstack cinder-volume[76388]: INFO cinder.keymgr.migration [None req-e73bdadd-49ab-4c03-93fb-1788444fff4b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG cinder.volume.drivers.lvm [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Updating volume stats {{(pid=76388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:44 devstack sudo[77215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:31:44 devstack sudo[77215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:44 devstack sudo[77215]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:44 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:44 devstack sudo[77218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:31:44 devstack sudo[77218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:45 devstack sudo[77218]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:45 devstack sudo[77221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:45 devstack sudo[77221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:45 devstack sudo[77221]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:45 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:31:45 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:45 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG cinder.manager [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Notifying Schedulers of capabilities ... {{(pid=76388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:31:45 devstack cinder-volume[76388]: INFO cinder.volume.manager [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Driver initialization completed successfully. Sep 01 01:31:45 devstack cinder-volume[76388]: INFO cinder.manager [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Initiating service 2 cleanup Sep 01 01:31:45 devstack cinder-volume[76388]: INFO cinder.manager [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Service 2 cleanup completed. Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG cinder.service [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Creating RPC server for service cinder-volume {{(pid=76388) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG cinder.service [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76388) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:31:45 devstack cinder-volume[76388]: INFO cinder.volume.manager [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG cinder.volume.drivers.lvm [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Updating volume stats {{(pid=76388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:31:45 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:45 devstack sudo[77229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:31:45 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:46 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:46 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:46 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:46 devstack sudo[77233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:31:46 devstack sudo[77233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:46 devstack sudo[77233]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:46 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:46 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:46 devstack sudo[77237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:31:46 devstack sudo[77237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:46 devstack sudo[77237]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:46 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:46 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:31:46 devstack sudo[77240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:31:46 devstack sudo[77240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:31:46 devstack sudo[77240]: pam_unix(sudo:session): session closed for user root Sep 01 01:31:46 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:31:47 devstack cinder-volume[76388]: INFO cinder.volume.manager [None req-a510164d-f88a-41ed-835f-e6d939558e33 None None] Driver post RPC initialization completed successfully. Sep 01 01:31:48 devstack cinder-volume[76225]: DEBUG dbcounter [-] [76225] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:31:55 devstack cinder-volume[76388]: DEBUG dbcounter [-] [76388] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:31:56 devstack cinder-volume[76388]: DEBUG dbcounter [-] [76388] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:32:01 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager._thread_info {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:32:01 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread count: 6 {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:32:01 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread info: [<_MainThread(MainThread, started 135745812967552)>, , , , , ] {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG cinder.volume.drivers.lvm [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Updating volume stats {{(pid=76388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:33:01 devstack sudo[79593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:33:01 devstack sudo[79593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:33:01 devstack sudo[79593]: pam_unix(sudo:session): session closed for user root Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:33:01 devstack sudo[79612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:33:01 devstack sudo[79612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:33:01 devstack sudo[79612]: pam_unix(sudo:session): session closed for user root Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:33:01 devstack sudo[79615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:33:01 devstack sudo[79615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:33:01 devstack sudo[79615]: pam_unix(sudo:session): session closed for user root Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:33:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:33:01 devstack sudo[79618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:33:01 devstack sudo[79618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:33:02 devstack sudo[79618]: pam_unix(sudo:session): session closed for user root Sep 01 01:33:02 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:33:02 devstack cinder-volume[76388]: DEBUG cinder.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Notifying Schedulers of capabilities ... {{(pid=76388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:33:02 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager._thread_info {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:33:02 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread count: 6 {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:33:02 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread info: [<_MainThread(MainThread, started 135745812967552)>, , , , , ] {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:33:57 devstack cinder-volume[76388]: DEBUG dbcounter [-] [76388] Writing DB stats cinder:SELECT=1 {{(pid=76388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:33:57 devstack cinder-volume[76388]: DEBUG dbcounter [-] [76388] Writing DB stats cinder:UPDATE=1 {{(pid=76388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG cinder.volume.drivers.lvm [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Updating volume stats {{(pid=76388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:34:01 devstack sudo[82822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:34:01 devstack sudo[82822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:34:01 devstack sudo[82822]: pam_unix(sudo:session): session closed for user root Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:34:01 devstack sudo[82826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:34:01 devstack sudo[82826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:34:01 devstack sudo[82826]: pam_unix(sudo:session): session closed for user root Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:34:01 devstack sudo[82829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:34:01 devstack sudo[82829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:34:01 devstack sudo[82829]: pam_unix(sudo:session): session closed for user root Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:34:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:34:01 devstack sudo[82839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:34:01 devstack sudo[82839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:34:02 devstack sudo[82839]: pam_unix(sudo:session): session closed for user root Sep 01 01:34:02 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:34:02 devstack cinder-volume[76388]: DEBUG cinder.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Notifying Schedulers of capabilities ... {{(pid=76388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:34:02 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager._thread_info {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:34:02 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread count: 6 {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:34:02 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread info: [<_MainThread(MainThread, started 135745812967552)>, , , , , ] {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG cinder.volume.drivers.lvm [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Updating volume stats {{(pid=76388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:35:01 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:35:01 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:35:01 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:35:01 devstack sudo[85054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:35:01 devstack sudo[85054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:35:01 devstack sudo[85054]: pam_unix(sudo:session): session closed for user root Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:35:01 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:35:01 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:35:01 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:35:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:35:01 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:35:01 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:35:02 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Sep 01 01:35:02 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:35:02 devstack cinder-volume[76388]: DEBUG cinder.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Notifying Schedulers of capabilities ... {{(pid=76388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:35:02 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager._thread_info {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:35:02 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread count: 6 {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:35:02 devstack cinder-volume[76388]: DEBUG cinder.volume.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] thread info: [<_MainThread(MainThread, started 135745812967552)>, , , , , ] {{(pid=76388) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:35:57 devstack cinder-volume[76388]: DEBUG dbcounter [-] [76388] Writing DB stats cinder:SELECT=1 {{(pid=76388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:35:57 devstack cinder-volume[76388]: DEBUG dbcounter [-] [76388] Writing DB stats cinder:UPDATE=1 {{(pid=76388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_service.periodic_task [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76388) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG cinder.volume.drivers.lvm [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Updating volume stats {{(pid=76388) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:01 devstack sudo[86253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:36:01 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:01 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:01 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:36:01 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:01 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:01 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:36:01 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:01 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:01 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:01 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:36:01 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:02 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:02 devstack cinder-volume[76388]: DEBUG oslo_concurrency.processutils [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:02 devstack cinder-volume[76388]: DEBUG cinder.manager [None req-da2ae670-3132-4ca2-a0f1-d193280173ed None None] Notifying Schedulers of capabilities ... {{(pid=76388) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:36:02 devstack cinder-volume[76225]: INFO oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Caught SIGTERM, stopping children Sep 01 01:36:02 devstack cinder-volume[76225]: DEBUG oslo_concurrency.lockutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Acquiring lock "singleton_lock" {{(pid=76225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:36:02 devstack cinder-volume[76225]: DEBUG oslo_concurrency.lockutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Acquired lock "singleton_lock" {{(pid=76225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:36:02 devstack cinder-volume[76225]: DEBUG oslo_concurrency.lockutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Releasing lock "singleton_lock" {{(pid=76225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:36:02 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Stop services. {{(pid=76225) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:36:02 devstack cinder-volume[76225]: DEBUG oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Killing children. {{(pid=76225) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:36:02 devstack cinder-volume[76225]: INFO oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Waiting on 1 children to exit Sep 01 01:36:05 devstack cinder-volume[76388]: DEBUG oslo_concurrency.lockutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Acquiring lock "singleton_lock" {{(pid=76388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:36:05 devstack cinder-volume[76388]: DEBUG oslo_concurrency.lockutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Acquired lock "singleton_lock" {{(pid=76388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:36:05 devstack cinder-volume[76388]: DEBUG oslo_concurrency.lockutils [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Releasing lock "singleton_lock" {{(pid=76388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:36:05 devstack cinder-volume[76388]: WARNING amqp [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:36:05 devstack cinder-volume[76388]: WARNING amqp [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:36:05 devstack cinder-volume[76225]: INFO oslo_service.backend._eventlet.service [None req-bacb478b-c8fe-4e75-b752-ea2dd683baa3 None None] Child 76388 exited with status 0 Sep 01 01:36:06 devstack cinder-volume[86379]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:36:06 devstack cinder-volume[86379]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:36:06 devstack cinder-volume[86379]: we strongly recommend against using it for new projects. Sep 01 01:36:06 devstack cinder-volume[86379]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:36:06 devstack cinder-volume[86379]: framework. For more detail see Sep 01 01:36:06 devstack cinder-volume[86379]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:36:06 devstack cinder-volume[86379]: import eventlet # noqa Sep 01 01:36:08 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:36:08 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:36:08 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:36:08 devstack cinder-volume[86379]: INFO dbcounter [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Registered counter for database cinder Sep 01 01:36:08 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG dbcounter [-] [86379] Writer thread running {{(pid=86379) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:36:09 devstack cinder-volume[86379]: INFO cinder.rpc [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:36:09 devstack cinder-volume[86379]: INFO cinder.rpc [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:09 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Determined volume DB was empty at startup. Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG cinder.volume.manager [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86379) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:36:09 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:36:09 devstack cinder-volume[86379]: WARNING stevedore.named [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:36:09 devstack cinder-volume[86379]: WARNING castellan.key_manager [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:36:09 devstack cinder-volume[86379]: WARNING cinder.keymgr.conf_key_mgr [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:36:09 devstack cinder-volume[86379]: INFO cinder.volume.manager [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_db.sqlalchemy.engines [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86379) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:09 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Starting 1 workers Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Started child 86594 {{(pid=86379) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Full set of CONF: {{(pid=86379) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Configuration options gathered from: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] ================================================================================ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] allow_availability_zone_fallback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86594]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] allow_compression_on_image_upload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] allowed_direct_url_schemes = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] api_rate_limit = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] auth_strategy = keystone {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_stats_polling_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backup_api_class = cinder.backup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backup_name_template = backup-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backup_use_same_host = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_internal_tenant_project_id = 6697ea0f57a9409783600d04cbaa09d3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_internal_tenant_user_id = 22985405dde14ed39e64f137884bedcd {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cluster = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] compression_format = gzip {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] compute_api_class = cinder.compute.nova.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] config_dir = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] config_source = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] control_exchange = openstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] debug = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] default_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] default_group_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] default_volume_type = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] enable_new_services = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] enabled_backends = ['QuobyteHD'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_api_insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_api_servers = ['http://192.168.122.53/image'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_api_ssl_compression = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_ca_certificates_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_catalog_info = image:glance:publicURL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_num_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance_request_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] graceful_shutdown_timeout = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] group_api_class = cinder.group.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] host = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_compress_on_upload = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_conversion_address_space_limit = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_conversion_cpu_limit = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_conversion_disable = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] init_host_max_objects_retrieval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] instance_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] iser_ip_address = 192.168.122.53 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86594) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_color = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_config_append = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_options = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_rotate_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_rotate_interval_type = days {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] log_rotation_type = none {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] max_age = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] max_logfile_count = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] max_logfile_size_mb = 200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] message_reap_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] message_ttl = 2592000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] migration_create_volume_timeout_secs = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] monkey_patch = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] monkey_patch_modules = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] my_ip = 192.168.122.53 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] no_snapshot_gb_quota = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] osapi_max_limit = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] osapi_volume_ext_list = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] osapi_volume_listen_port = 8776 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] osapi_volume_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] osapi_volume_workers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] per_volume_size_limit = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] periodic_fuzzy_delay = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] periodic_interval = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] public_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] publish_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] quota_backup_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] quota_backups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] quota_gigabytes = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] quota_groups = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] quota_snapshots = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] quota_volumes = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] rate_limit_burst = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] rate_limit_except_level = CRITICAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] rate_limit_interval = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] reinit_driver_count = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] report_interval = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] reservation_clean_interval = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] reservation_expire = 86400 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] reserved_image_namespaces = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] rpc_response_timeout = 120 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] run_external_periodic_tasks = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_down_time = 720 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] shell_completion = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] snapshot_name_template = snapshot-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] state_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] storage_availability_zone = nova {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] syslog_log_facility = LOG_USER {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] target_helper = lioadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] target_ip_address = 192.168.122.53 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] until_refresh = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] use_default_quota_class = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] use_journal = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] use_json = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] use_stderr = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] use_syslog = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] verify_glance_signatures = enabled {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_api_class = cinder.volume.api.API {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_name_template = volume-%s {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_service_inithost_offload = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volume_usage_audit_period = month {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] zoning_mode = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_concurrency.disable_process_locking = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.auth_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.include_service_catalog = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.interface = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcache_username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.service_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86594) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:36:09 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:36:09 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Running cmd (subprocess): mount.quobyte {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.backend = dogpile.cache.null {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.backend_argument = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.backend_expiration_time = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.config_prefix = cache.oslo {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.debug_cache_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.enable_retry_client = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.enable_socket_keepalive = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.expiration_time = 600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.hashclient_retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.memcache_dead_retry = 300 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.memcache_pool_maxsize = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.memcache_sasl_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.proxies = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.redis_db = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.redis_server = localhost:6379 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.retry_attempts = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.retry_delay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.socket_keepalive_count = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.socket_keepalive_idle = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.socket_keepalive_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.socket_timeout = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.tls_allowed_ciphers = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.tls_cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.tls_certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.tls_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.tls_keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cache.username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] coordination.backend_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.asyncio_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.asyncio_slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.backend = sqlalchemy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.connection_debug = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.connection_parameters = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.connection_recycle_time = 3600 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.connection_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.db_inc_retry_interval = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.db_max_retries = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.db_max_retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.db_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.max_overflow = 50 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.max_pool_size = 5 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.max_retries = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.mysql_wsrep_sync_wait = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.pool_timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.retry_interval = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.slave_connection = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.sqlite_synchronous = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.synchronous_reader = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] database.use_db_reconnect = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_tracing.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.connection_string = messaging:// {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.es_doc_type = notification {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.es_scroll_size = 10000 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.es_scroll_time = 2m {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.filter_error_trace = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.hmac_keys = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.sentinel_service_name = mymaster {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.socket_timeout = 0.1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.trace_requests = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler.trace_sqlalchemy = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler_jaeger.process_tags = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler_jaeger.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] profiler_otlp.service_name_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.enforce_new_defaults = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.policy_default_rule = default {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.policy_file = policy.yaml {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] privsep_osbrick.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] privsep_osbrick.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] privsep_osbrick.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_sys_admin.group = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_sys_admin.helper_command = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] cinder_sys_admin.user = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.send_service_user_token = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.auth_type = password {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] glance.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.chap_username = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.driver_use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.extra_capabilities = {} {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.iscsi_target_flags = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.iscsi_write_cache = on {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.iser_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.iser_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_host = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_login = admin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_private_key = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_share_path = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.num_shell_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.quobyte_volume_url = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.report_discard_supported = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.reserved_percentage = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.target_helper = tgtadm {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.target_port = 3260 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.target_protocol = iscsi {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.unique_fqdn_network = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.use_chap_auth = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_backend_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_clear = zero {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_clear_size = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_reports.file_event_handler = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_reports.log_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.backend_availability_zone = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.backend_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.chap_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.chap_username = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.chiscsi_conf = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.disk_geometry = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.driver_client_cert = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.driver_data_namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.driver_use_ssl = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.extra_capabilities = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.filter_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.goodness_function = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.iser_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.iser_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.iser_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.iser_target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack quobyte-client[86596]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_host = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_login = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack quobyte-client[86596]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_mount_options = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_password = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_private_key = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_share_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] CMD "mount.quobyte" returned: 1 in 0.128s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_ssh_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.num_shell_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.nvmet_port_id = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86594]: INFO cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 ... Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 -c /etc/quobyte/client-cinder.cfg {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.replication_device = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.report_discard_supported = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.reserved_percentage = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.scst_target_driver = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.storage_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.target_helper = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.target_ip_address = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.target_port = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.target_prefix = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.target_protocol = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.trace_flags = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.use_chap_auth = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_clear = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_clear_size = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] QuobyteHD.volumes_dir = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_notifications.driver = [] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_notifications.retry = -1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 -c /etc/quobyte/client-cinder.cfg Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] key_manager.fixed_key = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.barbican_api_version = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.barbican_endpoint = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.barbican_endpoint_type = public {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.barbican_region_name = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.number_of_retries = 60 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.retry_delay = 1 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.send_service_user_token = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.verify_ssl = True {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican.verify_ssl_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.auth_section = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.auth_type = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.cafile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.certfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.collect_timing = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.insecure = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.keyfile = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.split_loggers = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] barbican_service_user.timeout = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.approle_role_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.approle_secret_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.auth_method = approle {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.auth_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.kv_mountpoint = secret {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.kv_path = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.kv_version = 2 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.namespace = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.root_token_id = **** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.ssl_ca_crt_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.timeout = 60.0 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.token_file = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.token_role = None {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.use_ssl = False {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:09 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] ******************************************************************************** {{(pid=86379) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:36:10 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.455s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:10 devstack cinder-volume[86594]: INFO cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 succeeded Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.470s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:10 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:36:10 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:10 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.263s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:10 devstack cinder-volume[86594]: INFO cinder.volume.driver [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.volume.driver [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0979270935059, 'free_capacity_gb': 1774.0979270935059, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86594) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_db.sqlalchemy.engines [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writer thread running {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.db.api [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Building query based on filter {{(pid=86594) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86594) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:36:10 devstack cinder-volume[86594]: INFO cinder.keymgr.migration [None req-a5e0173d-9042-4d3e-b324-2ff5ead1505a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:10 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:36:10 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:10 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.233s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:36:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Driver initialization completed successfully. Sep 01 01:36:10 devstack cinder-volume[86594]: INFO cinder.manager [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Initiating service 3 cleanup Sep 01 01:36:10 devstack cinder-volume[86594]: INFO cinder.manager [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Service 3 cleanup completed. Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.service [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Creating RPC server for service cinder-volume {{(pid=86594) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:36:10 devstack cinder-volume[86594]: DEBUG cinder.service [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86594) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:36:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:36:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:36:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:36:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:36:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:36:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:36:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:11 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:36:11 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:11 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0eecae95-706d-4fd7-b8d2-7d4bec820a98 None None] Driver post RPC initialization completed successfully. Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:15 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:36:15 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:15 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.218s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:15 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-8bf897a7-9121-49ce-8297-3fa164cbe675 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:36:17 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Caught SIGTERM, stopping children Sep 01 01:36:17 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Acquiring lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:36:17 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Acquired lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:36:17 devstack cinder-volume[86379]: DEBUG oslo_concurrency.lockutils [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Releasing lock "singleton_lock" {{(pid=86379) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:36:17 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Stop services. {{(pid=86379) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:36:17 devstack cinder-volume[86379]: DEBUG oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Killing children. {{(pid=86379) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:36:17 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Waiting on 1 children to exit Sep 01 01:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Acquiring lock "singleton_lock" {{(pid=86594) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Acquired lock "singleton_lock" {{(pid=86594) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Releasing lock "singleton_lock" {{(pid=86594) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:36:19 devstack cinder-volume[86594]: WARNING amqp [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:36:19 devstack cinder-volume[86594]: WARNING amqp [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:36:19 devstack cinder-volume[86379]: INFO oslo_service.backend._eventlet.service [None req-4ffa7718-1276-4d3d-9c18-3ecba381a313 None None] Child 86594 exited with status 0 Sep 01 01:36:20 devstack cinder-volume[86911]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:36:20 devstack cinder-volume[86911]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:36:20 devstack cinder-volume[86911]: we strongly recommend against using it for new projects. Sep 01 01:36:20 devstack cinder-volume[86911]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:36:20 devstack cinder-volume[86911]: framework. For more detail see Sep 01 01:36:20 devstack cinder-volume[86911]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:36:20 devstack cinder-volume[86911]: import eventlet # noqa Sep 01 01:36:23 devstack cinder-volume[86911]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:36:23 devstack cinder-volume[86911]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:36:23 devstack cinder-volume[86911]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86911) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:36:23 devstack cinder-volume[86911]: INFO dbcounter [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Registered counter for database cinder Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_db.sqlalchemy.engines [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86911) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG dbcounter [-] [86911] Writer thread running {{(pid=86911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:36:24 devstack cinder-volume[86911]: INFO cinder.rpc [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:36:24 devstack cinder-volume[86911]: INFO cinder.rpc [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_db.sqlalchemy.engines [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86911) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:24 devstack cinder-volume[86911]: INFO cinder.volume.manager [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Determined volume DB was empty at startup. Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG cinder.volume.manager [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86911) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:36:24 devstack cinder-volume[86911]: WARNING stevedore.named [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:36:24 devstack cinder-volume[86911]: WARNING castellan.key_manager [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:36:24 devstack cinder-volume[86911]: WARNING cinder.keymgr.conf_key_mgr [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:36:24 devstack cinder-volume[86911]: INFO cinder.volume.manager [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_db.sqlalchemy.engines [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86911) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:24 devstack cinder-volume[86911]: INFO oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Starting 1 workers Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Started child 87212 {{(pid=86911) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Full set of CONF: {{(pid=86911) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] ******************************************************************************** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] Configuration options gathered from: {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] ================================================================================ {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] allow_availability_zone_fallback = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] allow_compression_on_image_upload = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] allowed_direct_url_schemes = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] api_rate_limit = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] auth_strategy = keystone {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_availability_zone = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_host = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_stats_polling_interval = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backup_api_class = cinder.backup.api.API {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[87212]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backup_name_template = backup-%s {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backup_use_same_host = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backup_use_temp_snapshot = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] chap_password = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] chap_username = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_internal_tenant_project_id = 6697ea0f57a9409783600d04cbaa09d3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_internal_tenant_user_id = 22985405dde14ed39e64f137884bedcd {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cluster = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] compression_format = gzip {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] compute_api_class = cinder.compute.nova.API {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] config_dir = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] config_source = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] control_exchange = openstack {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] debug = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] default_availability_zone = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] default_group_type = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] default_volume_type = QuobyteHD {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] disk_geometry = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] driver_client_cert = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] driver_client_cert_key = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] driver_data_namespace = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] driver_ssl_cert_path = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] driver_ssl_cert_verify = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] driver_use_ssl = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] enable_new_services = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] enable_unsupported_driver = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] enabled_backends = ['QuobyteHD'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] enforce_multipath_for_image_xfer = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] filter_function = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_api_insecure = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_api_servers = ['http://192.168.122.53/image'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_api_ssl_compression = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_ca_certificates_file = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_catalog_info = image:glance:publicURL {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_num_retries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance_request_timeout = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] goodness_function = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] graceful_shutdown_timeout = 5 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] group_api_class = cinder.group.api.API {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] host = devstack {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_compress_on_upload = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_conversion_address_space_limit = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_conversion_cpu_limit = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_conversion_disable = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_upload_use_cinder_backend = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_upload_use_internal_tenant = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_volume_cache_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_volume_cache_max_count = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] image_volume_cache_max_size_gb = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] init_host_max_objects_retrieval = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] instance_format = [instance: %(uuid)s] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] iscsi_target_flags = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] iscsi_write_cache = on {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] iser_helper = tgtadm {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] iser_ip_address = 192.168.122.53 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] iser_port = 3260 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_color = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_config_append = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_dir = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_file = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_options = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_rotate_interval = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_rotate_interval_type = days {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] log_rotation_type = none {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] max_age = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] max_logfile_count = 30 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] max_logfile_size_mb = 200 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] max_over_subscription_ratio = 20.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] message_reap_interval = 86400 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] message_ttl = 2592000 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] migration_create_volume_timeout_secs = 300 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] monkey_patch = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] monkey_patch_modules = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] my_ip = 192.168.122.53 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] no_snapshot_gb_quota = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] num_iser_scan_tries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] num_shell_tries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] num_volume_device_scan_tries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] nvmeof_conn_info_version = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] nvmet_ns_id = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] nvmet_port_id = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] osapi_max_limit = 1000 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] osapi_volume_ext_list = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] osapi_volume_listen_port = 8776 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] osapi_volume_use_ssl = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] osapi_volume_workers = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] per_volume_size_limit = -1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] periodic_fuzzy_delay = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] periodic_interval = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] public_endpoint = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] publish_errors = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] quota_backup_gigabytes = 1000 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] quota_backups = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] quota_gigabytes = 1000 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] quota_groups = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] quota_snapshots = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] quota_volumes = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] rate_limit_burst = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] rate_limit_except_level = CRITICAL {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] rate_limit_interval = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] reinit_driver_count = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] replication_device = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] report_discard_supported = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] report_interval = 120 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] reservation_clean_interval = 86400 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] reservation_expire = 86400 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] reserved_image_namespaces = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] reserved_percentage = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] rpc_response_timeout = 120 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] run_external_periodic_tasks = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] scst_target_driver = iscsi {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] scst_target_iqn_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_down_time = 720 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] shell_completion = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] snapshot_name_template = snapshot-%s {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] split_loggers = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] state_path = /opt/stack/data/cinder {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] storage_availability_zone = nova {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] storage_protocol = iSCSI {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] syslog_log_facility = LOG_USER {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] target_helper = lioadm {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] target_ip_address = 192.168.122.53 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] target_port = 3260 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] target_protocol = iscsi {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] target_secondary_ip_addresses = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] trace_flags = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] transport_url = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] until_refresh = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] use_chap_auth = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] use_default_quota_class = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] use_journal = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] use_json = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] use_multipath_for_image_xfer = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] use_stderr = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] use_syslog = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] verify_glance_signatures = enabled {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_api_class = cinder.volume.api.API {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_backend_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_clear = zero {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_clear_ionice = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_clear_size = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_copy_bps_limit = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_dd_blocksize = 1M {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_name_template = volume-%s {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_service_inithost_offload = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volume_usage_audit_period = month {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] zoning_mode = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_concurrency.disable_process_locking = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.auth_section = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.auth_type = password {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.auth_version = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.cache = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.include_service_catalog = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.insecure = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.interface = public {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_password = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcache_username = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.region_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.service_type = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.backend = dogpile.cache.null {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.backend_argument = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.backend_expiration_time = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.config_prefix = cache.oslo {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.debug_cache_backend = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.enable_retry_client = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.enable_socket_keepalive = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.expiration_time = 600 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.hashclient_retry_attempts = 2 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.memcache_dead_retry = 300 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.memcache_pool_maxsize = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.memcache_sasl_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.password = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.proxies = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.redis_db = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.redis_server = localhost:6379 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.retry_attempts = 2 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.retry_delay = 0.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.socket_keepalive_count = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.socket_keepalive_idle = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.socket_keepalive_interval = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.socket_timeout = 1.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87212) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.tls_allowed_ciphers = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.tls_cafile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.tls_certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.tls_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.tls_keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cache.username = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] coordination.backend_url = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.asyncio_connection = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.asyncio_slave_connection = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.backend = sqlalchemy {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.connection = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.connection_debug = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.connection_parameters = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.connection_recycle_time = 3600 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.connection_trace = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.db_inc_retry_interval = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.db_max_retries = 20 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.db_max_retry_interval = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.db_retry_interval = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.max_overflow = 50 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.max_pool_size = 5 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.max_retries = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.mysql_wsrep_sync_wait = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.pool_timeout = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.retry_interval = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.slave_connection = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.sqlite_synchronous = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.synchronous_reader = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] database.use_db_reconnect = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_tracing.insecure = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.connection_string = messaging:// {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.es_doc_type = notification {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.es_scroll_size = 10000 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.es_scroll_time = 2m {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.filter_error_trace = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.hmac_keys = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.sentinel_service_name = mymaster {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.socket_timeout = 0.1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.trace_requests = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler.trace_sqlalchemy = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler_jaeger.process_tags = {} {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler_jaeger.service_name_prefix = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] profiler_otlp.service_name_prefix = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.enforce_new_defaults = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.policy_default_rule = default {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.policy_file = policy.yaml {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] privsep_osbrick.group = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] privsep_osbrick.helper_command = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] privsep_osbrick.user = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_sys_admin.group = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_sys_admin.helper_command = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] cinder_sys_admin.user = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.auth_section = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.auth_type = password {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.cafile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.collect_timing = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.insecure = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.send_service_user_token = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.split_loggers = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] service_user.timeout = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.auth_section = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.auth_type = password {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.collect_timing = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.insecure = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.region_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.split_loggers = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] glance.timeout = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.backend_availability_zone = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:24 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.chap_password = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.chap_username = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.disk_geometry = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.driver_client_cert = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.driver_client_cert_key = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.driver_data_namespace = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.driver_use_ssl = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.extra_capabilities = {} {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.filter_function = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.goodness_function = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.iscsi_target_flags = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.iscsi_write_cache = on {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.iser_helper = tgtadm {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.iser_port = 3260 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_host = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_login = admin {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_mount_options = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_password = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_private_key = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_share_path = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.num_shell_tries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.quobyte_volume_url = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.replication_device = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.report_discard_supported = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.reserved_percentage = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.target_helper = tgtadm {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.target_port = 3260 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.target_protocol = iscsi {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.trace_flags = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.unique_fqdn_network = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.use_chap_auth = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_backend_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_clear = zero {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_clear_ionice = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_clear_size = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_reports.file_event_handler = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_reports.log_dir = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.backend_availability_zone = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.backend_host = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.chap_password = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.chap_username = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.chiscsi_conf = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.disk_geometry = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.driver_client_cert = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.driver_data_namespace = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.driver_use_ssl = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.extra_capabilities = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.filter_function = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.goodness_function = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.iser_helper = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.iser_ip_address = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.iser_port = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.iser_target_prefix = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_host = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_login = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_mount_options = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_password = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_private_key = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_share_path = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_ssh_port = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.num_shell_tries = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.nvmet_port_id = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.replication_device = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.report_discard_supported = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.reserved_percentage = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.scst_target_driver = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.storage_protocol = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.target_helper = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.target_ip_address = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.target_port = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.target_prefix = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.target_protocol = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.trace_flags = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.use_chap_auth = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_clear = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_clear_size = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] QuobyteHD.volumes_dir = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.ssl = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87212) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:36:25 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:36:25 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Running cmd (subprocess): mount.quobyte {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_notifications.driver = [] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_notifications.retry = -1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] key_manager.fixed_key = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.barbican_api_version = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.barbican_endpoint = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.barbican_endpoint_type = public {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.barbican_region_name = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.cafile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.collect_timing = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.insecure = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.number_of_retries = 60 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.retry_delay = 1 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.send_service_user_token = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.split_loggers = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.timeout = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.verify_ssl = True {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican.verify_ssl_path = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.auth_section = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack quobyte-client[87213]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.auth_type = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.cafile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.certfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.collect_timing = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.insecure = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.keyfile = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.split_loggers = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack quobyte-client[87213]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] barbican_service_user.timeout = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.approle_role_id = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.approle_secret_id = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.auth_method = approle {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.auth_path = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.kv_mountpoint = secret {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.kv_path = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.kv_version = 2 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.namespace = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.root_token_id = **** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.ssl_ca_crt_file = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.timeout = 60.0 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.token_file = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.token_role = None {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.use_ssl = False {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:36:25 devstack cinder-volume[86911]: DEBUG oslo_service.backend._eventlet.service [None req-6e27c422-9568-454b-93e9-563cbd5e7920 None None] ******************************************************************************** {{(pid=86911) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:25 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:36:25 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:25 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.229s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:25 devstack cinder-volume[87212]: INFO cinder.volume.driver [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.driver [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0979270935059, 'free_capacity_gb': 1774.0979270935059, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87212) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_db.sqlalchemy.engines [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87212) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writer thread running {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.db.api [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Building query based on filter {{(pid=87212) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87212) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:25 devstack cinder-volume[87212]: INFO cinder.keymgr.migration [None req-0ab0f194-691d-47a9-96bb-8a2d4ff85dcb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:36:25 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:36:25 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:25 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.238s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:36:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Driver initialization completed successfully. Sep 01 01:36:25 devstack cinder-volume[87212]: INFO cinder.manager [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Initiating service 3 cleanup Sep 01 01:36:25 devstack cinder-volume[87212]: INFO cinder.manager [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Service 3 cleanup completed. Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.service [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Creating RPC server for service cinder-volume {{(pid=87212) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.service [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87212) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:36:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:36:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:36:25 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:36:25 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:36:26 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Sep 01 01:36:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.231s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:36:26 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b53e8e41-879d-4e63-9b7f-936b95a53aa8 None None] Driver post RPC initialization completed successfully. Sep 01 01:36:34 devstack cinder-volume[86911]: DEBUG dbcounter [-] [86911] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86911) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:36:35 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=2 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:36:36 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:37:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:37:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 6 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:37:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Flow 'volume_create_manager' (da9911c2-a032-4e4c-96db-5b09e360b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b2080e-5d2c-4a28-8423-602be09f1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b2080e-5d2c-4a28-8423-602be09f1c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1986211302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a099e6f-5127-47f7-b373-7455a5db251b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77955bc060b34f48b58fd4dfe51ff0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:37:45Z,use_quota=True,user_id='d0fb8b8b595f487380fd0d12455b9ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dc27f0-d33f-4cd0-957f-eee636780f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10dc27f0-d33f-4cd0-957f-eee636780f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c938e45-3a6b-4f65-a24c-baee85105b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c938e45-3a6b-4f65-a24c-baee85105b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a099e6f-5127-47f7-b373-7455a5db251b', 'volume_name': 'volume-2a099e6f-5127-47f7-b373-7455a5db251b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c918c1-e320-4d9f-84b6-7fe7c1720e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c918c1-e320-4d9f-84b6-7fe7c1720e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f83de2-8dd2-4ef4-91b6-bc4b547dff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:45 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Volume 2a099e6f-5127-47f7-b373-7455a5db251b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a099e6f-5127-47f7-b373-7455a5db251b', 'volume_size': 1} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1986211302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a099e6f-5127-47f7-b373-7455a5db251b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77955bc060b34f48b58fd4dfe51ff0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:37:45Z,use_quota=True,user_id='d0fb8b8b595f487380fd0d12455b9ef0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Creating volume 2a099e6f-5127-47f7-b373-7455a5db251b {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:37:45 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:37:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:46 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b 1073741824 Sep 01 01:37:46 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:47 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b 1073741824" returned: 0 in 1.771s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:47 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b Sep 01 01:37:47 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:48 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b" returned: 0 in 0.758s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] <== create_volume: return (2679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.682s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f83de2-8dd2-4ef4-91b6-bc4b547dff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a099e6f-5127-47f7-b373-7455a5db251b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75d1c84-2969-427a-8ebe-aa64397609ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:48 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Volume volume-2a099e6f-5127-47f7-b373-7455a5db251b (2a099e6f-5127-47f7-b373-7455a5db251b): created successfully Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75d1c84-2969-427a-8ebe-aa64397609ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Flow 'volume_create_manager' (da9911c2-a032-4e4c-96db-5b09e360b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:37:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3a1dcab6-29bc-4633-8169-48e8219127c2 tempest-DeleteServersTestJSON-1088604417 None] Created volume successfully. Sep 01 01:37:48 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Flow 'volume_create_manager' (dc374f40-2778-4e67-ae4a-441f58047514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7098ec80-a56d-4d89-9340-129eff75b5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7098ec80-a56d-4d89-9340-129eff75b5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1931127487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331aba70-7fc3-4453-a075-a708048b07b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edd6c16dd73489098af417187f6d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:37:49Z,use_quota=True,user_id='e95268e349b34652a5983fa278f1ef3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a1cd81-2f46-4299-8834-270b925676f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a1cd81-2f46-4299-8834-270b925676f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66760bd8-0ef4-426a-9ec6-f44a6f8bef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66760bd8-0ef4-426a-9ec6-f44a6f8bef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '331aba70-7fc3-4453-a075-a708048b07b2', 'volume_name': 'volume-331aba70-7fc3-4453-a075-a708048b07b2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ed0036-48c5-4d9d-aea6-d0a6558b6456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ed0036-48c5-4d9d-aea6-d0a6558b6456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661f909a-2923-46a1-a706-894c35e9cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:49 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Volume 331aba70-7fc3-4453-a075-a708048b07b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-331aba70-7fc3-4453-a075-a708048b07b2', 'volume_size': 1} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1931127487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=331aba70-7fc3-4453-a075-a708048b07b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edd6c16dd73489098af417187f6d144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:37:49Z,use_quota=True,user_id='e95268e349b34652a5983fa278f1ef3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Creating volume 331aba70-7fc3-4453-a075-a708048b07b2 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:37:49 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:37:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:49 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 1073741824 Sep 01 01:37:49 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:50 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 1073741824" returned: 0 in 0.997s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:50 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 Sep 01 01:37:50 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:51 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2" returned: 0 in 0.667s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:37:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661f909a-2923-46a1-a706-894c35e9cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-331aba70-7fc3-4453-a075-a708048b07b2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6a07eb-ee47-430c-8cc0-767fc7c99ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Volume volume-331aba70-7fc3-4453-a075-a708048b07b2 (331aba70-7fc3-4453-a075-a708048b07b2): created successfully Sep 01 01:37:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6a07eb-ee47-430c-8cc0-767fc7c99ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Flow 'volume_create_manager' (dc374f40-2778-4e67-ae4a-441f58047514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:37:51 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a406634c-4f18-42cb-9b6b-51275c46b851 tempest-VolumesAdminNegativeTest-1297592202 None] Created volume successfully. Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Acquiring lock "cinder-331aba70-7fc3-4453-a075-a708048b07b2-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Lock "cinder-331aba70-7fc3-4453-a075-a708048b07b2-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Flow 'volume_create_manager' (3bd5b7d5-0bcc-4ee1-8b89-b1d3f85c6df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8887f7df-cd6b-465a-8200-c79c39f3073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8887f7df-cd6b-465a-8200-c79c39f3073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1810222463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f332ad85db884c5ebd9963e29c4206f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:37:54Z,use_quota=True,user_id='6c95bd46f3164beea8aca865d02ee041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb815c6c-9054-49a3-829b-d8993ffae93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb815c6c-9054-49a3-829b-d8993ffae93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40243566-1ca0-444f-ba9e-4635ba1c38b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40243566-1ca0-444f-ba9e-4635ba1c38b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7', 'volume_name': 'volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4700e5-a7c3-4b17-a6e6-e25183053f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4700e5-a7c3-4b17-a6e6-e25183053f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd1e1f1-e90b-45c4-ac47-6fb90764b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:53 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Volume cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7', 'volume_size': 1} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1810222463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f332ad85db884c5ebd9963e29c4206f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:37:54Z,use_quota=True,user_id='6c95bd46f3164beea8aca865d02ee041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Creating volume cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:37:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:37:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:37:54 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:37:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Acquiring lock "cinder-quobyte-331aba70-7fc3-4453-a075-a708048b07b2" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:37:54 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 1073741824 Sep 01 01:37:54 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Lock "cinder-quobyte-331aba70-7fc3-4453-a075-a708048b07b2" acquired by "delete_volume" :: waited 0.038s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:37:54 devstack cinder-volume[87212]: INFO oslo.privsep.daemon [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6xaw1zhq/privsep.sock'] Sep 01 01:37:54 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6xaw1zhq/privsep.sock Sep 01 01:37:54 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:55 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 1073741824" returned: 0 in 1.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:55 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 Sep 01 01:37:55 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:56 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7" returned: 0 in 0.850s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd1e1f1-e90b-45c4-ac47-6fb90764b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ce9d41-6566-4019-a612-bbcaa89da22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:37:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Volume volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 (cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7): created successfully Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ce9d41-6566-4019-a612-bbcaa89da22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Flow 'volume_create_manager' (3bd5b7d5-0bcc-4ee1-8b89-b1d3f85c6df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:37:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-51d4028b-cef1-407d-8c69-90b05b8e5268 tempest-ServerRescueNegativeTestJSON-1972681194 None] Created volume successfully. Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 01:37:56 devstack cinder-volume[87212]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 01:37:56 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:56 devstack cinder-volume[87212]: INFO oslo.privsep.daemon [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Spawned new privsep daemon via rootwrap Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Accepted privsep connection to /tmp/tmp6xaw1zhq/privsep.sock {{(pid=87212) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 01:37:56 devstack cinder-volume[87212]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 01:37:56 devstack cinder-volume[87212]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 01:37:56 devstack cinder-volume[87212]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 01:37:56 devstack cinder-volume[87212]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88472 Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc3aaf-ecb0-452b-91dc-7767048a301a]: (2,) {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd287a68-639c-4f8a-8676-33973ae8ddec]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:37:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:57 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 Sep 01 01:37:57 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:57 devstack cinder-volume[87212]: WARNING py.warnings [req-ef54ac49-7415-4477-b8ff-28fd55fdd684 req-255e1164-2924-46dc-b7ee-58d276559336 tempest-DeleteServersTestJSON-1088604417 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 01 01:37:57 devstack cinder-volume[87212]: .first() Sep 01 01:37:57 devstack cinder-volume[87212]: Sep 01 01:37:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-ef54ac49-7415-4477-b8ff-28fd55fdd684 req-255e1164-2924-46dc-b7ee-58d276559336 tempest-DeleteServersTestJSON-1088604417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-ef54ac49-7415-4477-b8ff-28fd55fdd684 req-255e1164-2924-46dc-b7ee-58d276559336 tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-ef54ac49-7415-4477-b8ff-28fd55fdd684 req-255e1164-2924-46dc-b7ee-58d276559336 tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-ef54ac49-7415-4477-b8ff-28fd55fdd684 req-255e1164-2924-46dc-b7ee-58d276559336 tempest-DeleteServersTestJSON-1088604417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-2a099e6f-5127-47f7-b373-7455a5db251b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9cb003c-ef02-4d82-ba5a-6a8a5d77375a', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:37:58 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-ef54ac49-7415-4477-b8ff-28fd55fdd684 req-255e1164-2924-46dc-b7ee-58d276559336 tempest-DeleteServersTestJSON-1088604417 None] attachment_update completed successfully. Sep 01 01:37:58 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2" returned: 0 in 1.420s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:37:58 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2 Sep 01 01:37:58 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:37:58 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Sep 01 01:37:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-331aba70-7fc3-4453-a075-a708048b07b2" returned: 0 in 0.518s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Lock "cinder-quobyte-331aba70-7fc3-4453-a075-a708048b07b2" released by "delete_volume" :: held 4.947s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:37:59 devstack cinder-volume[87212]: WARNING cinder.quota [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:37:59 devstack cinder-volume[87212]: WARNING cinder.quota [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Created reservations ['efe88b9d-382d-4a95-8e8c-0b7669b245ec', '7255692d-b086-4275-a761-e8875a7bb298', '8fc9bc2b-bec7-4dbb-b487-99a2d5cab4ee', '16509288-ed0c-4af4-ae06-08eed4f37f27'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:37:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:00 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:38:00 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:00 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 1.111s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:01 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:38:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Deleted volume successfully. Sep 01 01:38:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d2772acf-9848-4531-82f6-6086d7009c0a tempest-VolumesAdminNegativeTest-1297592202 None] Lock "cinder-331aba70-7fc3-4453-a075-a708048b07b2-delete_volume" released by "delete_volume" :: held 7.625s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:38:06 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-912e9373-b708-40ca-b2ec-4979e921be7f req-259a54e4-d8b7-448e-b756-b61934991cd4 tempest-DeleteServersTestJSON-1088604417 None] Terminate volume connection completed successfully. Sep 01 01:38:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-912e9373-b708-40ca-b2ec-4979e921be7f req-259a54e4-d8b7-448e-b756-b61934991cd4 tempest-DeleteServersTestJSON-1088604417 None] Deleting attachment c9cb003c-ef02-4d82-ba5a-6a8a5d77375a. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Acquiring lock "cinder-2a099e6f-5127-47f7-b373-7455a5db251b-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Lock "cinder-2a099e6f-5127-47f7-b373-7455a5db251b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Acquiring lock "cinder-quobyte-2a099e6f-5127-47f7-b373-7455a5db251b" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Lock "cinder-quobyte-2a099e6f-5127-47f7-b373-7455a5db251b" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e12b88c-ed29-4571-a233-7ff07b127568]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:09 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b Sep 01 01:38:09 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:09 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b" returned: 0 in 0.575s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:10 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b Sep 01 01:38:10 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:10 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2a099e6f-5127-47f7-b373-7455a5db251b" returned: 0 in 0.527s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Lock "cinder-quobyte-2a099e6f-5127-47f7-b373-7455a5db251b" released by "delete_volume" :: held 1.203s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Created reservations ['13af3c04-58f3-41a4-aa72-f69f1e241150', '33ff0244-caee-4954-b986-e1c331a2cb20', '7c0d66d5-a63d-4dd7-aff6-d8b6bcdb60ae', '138b065a-2834-4766-a0f3-33342f8459ae'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:38:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:10 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:38:10 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:11 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.607s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:11 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:38:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Deleted volume successfully. Sep 01 01:38:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2b3e7a5d-1250-4a9f-bc5e-d864e69013ed tempest-DeleteServersTestJSON-1088604417 None] Lock "cinder-2a099e6f-5127-47f7-b373-7455a5db251b-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:38:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Acquiring lock "cinder-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:38:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "cinder-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:38:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Acquiring lock "cinder-quobyte-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:38:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "cinder-quobyte-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:38:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a20b5-681f-4b87-8347-13cb310587c3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:38:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:16 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 Sep 01 01:38:16 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:16 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7" returned: 0 in 0.410s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:16 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7 Sep 01 01:38:16 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:16 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7" returned: 0 in 0.297s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "cinder-quobyte-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7" released by "delete_volume" :: held 0.781s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Created reservations ['963c9f21-34eb-4b5d-b476-484bb71d1493', 'da5e26c6-792f-49f6-8f0e-a90d76e3a97a', 'a1780e07-8982-4bdb-a686-fe81825c1e45', '5567f167-b98f-4725-be1a-75009a12ea0c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:38:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:16 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:38:16 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:38:17 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:38:17 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:38:17 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.660s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:38:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Deleted volume successfully. Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ee11c063-4285-4e5f-9d2f-aa024041a2cb tempest-ServerRescueNegativeTestJSON-1972681194 None] Lock "cinder-cbb812a7-c0aa-472f-bb6f-1b6dc638f3e7-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:38:17 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.672s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 8 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:38:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:38:36 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=31,cinder:UPDATE=35,cinder:DELETE=5,cinder:INSERT=7 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:38:36 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=35,cinder:INSERT=8,cinder:SELECT=27,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Flow 'volume_create_manager' (309cbf69-8220-4793-9a7b-ac686cc916a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4326b5-b38c-44ee-9b61-67f23ccbd135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4326b5-b38c-44ee-9b61-67f23ccbd135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-671440853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a078276c-06d2-44da-a204-2fe40921418f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1a0cc4e4ef4caf8b0682d3b4d47679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:07Z,use_quota=True,user_id='eddbfa1317e34e638a60d917bf6ee57e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae74d51-2e43-4669-9222-035257336942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae74d51-2e43-4669-9222-035257336942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769ca49d-7f30-4ad0-9366-e9dd5b85841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (769ca49d-7f30-4ad0-9366-e9dd5b85841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a078276c-06d2-44da-a204-2fe40921418f', 'volume_name': 'volume-a078276c-06d2-44da-a204-2fe40921418f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3392b6-5b98-487b-b1da-a5d2ce8eefe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3392b6-5b98-487b-b1da-a5d2ce8eefe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce07e74-5226-4f3c-aae7-3e6244373006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:07 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Volume a078276c-06d2-44da-a204-2fe40921418f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a078276c-06d2-44da-a204-2fe40921418f', 'volume_size': 1} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-671440853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a078276c-06d2-44da-a204-2fe40921418f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e1a0cc4e4ef4caf8b0682d3b4d47679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:07Z,use_quota=True,user_id='eddbfa1317e34e638a60d917bf6ee57e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Creating volume a078276c-06d2-44da-a204-2fe40921418f {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:39:07 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:39:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:07 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f 1073741824 Sep 01 01:39:07 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:08 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f 1073741824" returned: 0 in 0.654s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:08 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f Sep 01 01:39:08 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:08 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f" returned: 0 in 0.511s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce07e74-5226-4f3c-aae7-3e6244373006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a078276c-06d2-44da-a204-2fe40921418f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1328175-7c79-4513-a53d-8beb16a182ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:08 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Volume volume-a078276c-06d2-44da-a204-2fe40921418f (a078276c-06d2-44da-a204-2fe40921418f): created successfully Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1328175-7c79-4513-a53d-8beb16a182ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Flow 'volume_create_manager' (309cbf69-8220-4793-9a7b-ac686cc916a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2622ae74-1887-44b2-8e14-191197e432e2 tempest-TaggedAttachmentsTest-1902109829 None] Created volume successfully. Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:17 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:39:17 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:17 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.597s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:39:18 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=4 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:39:18 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Flow 'volume_create_manager' (f5d2ba64-be87-44e1-95c7-01c850879bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db912bf7-804e-4caf-ac22-7d7ca48afa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db912bf7-804e-4caf-ac22-7d7ca48afa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-995902219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc49c9e9-71e6-4e1b-872e-c8891e5a36fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b42c9be04c4692316833c98db7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:28Z,use_quota=True,user_id='9bac913bdadb4f729656678e4132a720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51feed4a-75d0-4958-94cb-8d0f2be3c316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51feed4a-75d0-4958-94cb-8d0f2be3c316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e316298e-79d4-4dce-99b1-8e6dbc223dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e316298e-79d4-4dce-99b1-8e6dbc223dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc49c9e9-71e6-4e1b-872e-c8891e5a36fc', 'volume_name': 'volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424ea34f-025b-4fc7-8cb0-b03ce22050b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424ea34f-025b-4fc7-8cb0-b03ce22050b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9786a7e2-1683-42fd-81f2-5d1a93779ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Volume dc49c9e9-71e6-4e1b-872e-c8891e5a36fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc', 'volume_size': 1} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-995902219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc49c9e9-71e6-4e1b-872e-c8891e5a36fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b42c9be04c4692316833c98db7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:28Z,use_quota=True,user_id='9bac913bdadb4f729656678e4132a720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Creating volume dc49c9e9-71e6-4e1b-872e-c8891e5a36fc {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:39:28 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:39:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:28 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc 1073741824 Sep 01 01:39:28 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:29 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc 1073741824" returned: 0 in 0.988s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:29 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc Sep 01 01:39:29 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:30 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc" returned: 0 in 0.759s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:39:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9786a7e2-1683-42fd-81f2-5d1a93779ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d00b29-941a-4088-81d2-3ffe4094d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Volume volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc (dc49c9e9-71e6-4e1b-872e-c8891e5a36fc): created successfully Sep 01 01:39:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d00b29-941a-4088-81d2-3ffe4094d418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Flow 'volume_create_manager' (f5d2ba64-be87-44e1-95c7-01c850879bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-09325a17-cd2d-4aa0-890f-5038f0c214ba tempest-AttachVolumeTestJSON-216990028 None] Created volume successfully. Sep 01 01:39:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-788c43cc-8e27-4558-9e2a-71a86a0958a1 req-f740340c-1917-4636-8e2c-3a30e0fef4e2 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-788c43cc-8e27-4558-9e2a-71a86a0958a1 req-f740340c-1917-4636-8e2c-3a30e0fef4e2 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-788c43cc-8e27-4558-9e2a-71a86a0958a1 req-f740340c-1917-4636-8e2c-3a30e0fef4e2 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-788c43cc-8e27-4558-9e2a-71a86a0958a1 req-f740340c-1917-4636-8e2c-3a30e0fef4e2 tempest-AttachVolumeTestJSON-216990028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ebf4a8f-5da2-4d78-a8d3-b612ad6a21d3', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:39:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-788c43cc-8e27-4558-9e2a-71a86a0958a1 req-f740340c-1917-4636-8e2c-3a30e0fef4e2 tempest-AttachVolumeTestJSON-216990028 None] attachment_update completed successfully. Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Flow 'volume_create_manager' (403133d7-c57d-4edf-9906-e759a08a5024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e32813-f1ed-4ebb-963f-8ff49abfbe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e32813-f1ed-4ebb-963f-8ff49abfbe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1747316210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5a6159-b2ea-4de5-8c7c-f4c53840768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2c34981a8149beac5e88dcf6dc1ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:38Z,use_quota=True,user_id='9f3f56d84a574cc4874a7efd1f8250ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9948e9c8-b7b1-485c-90c8-9434af8b3df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9948e9c8-b7b1-485c-90c8-9434af8b3df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba538a5-a003-4547-8c8f-6dc397e107ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba538a5-a003-4547-8c8f-6dc397e107ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5a6159-b2ea-4de5-8c7c-f4c53840768d', 'volume_name': 'volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfe6a74-a8e2-4442-b863-3694194e42e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cfe6a74-a8e2-4442-b863-3694194e42e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f94cbf0-0020-4097-9b0b-19174258885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Volume 4a5a6159-b2ea-4de5-8c7c-f4c53840768d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d', 'volume_size': 1} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1747316210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5a6159-b2ea-4de5-8c7c-f4c53840768d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2c34981a8149beac5e88dcf6dc1ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:38Z,use_quota=True,user_id='9f3f56d84a574cc4874a7efd1f8250ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Creating volume 4a5a6159-b2ea-4de5-8c7c-f4c53840768d {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:39:38 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:38 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d 1073741824 Sep 01 01:39:38 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:38 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d 1073741824" returned: 0 in 0.471s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:39 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d Sep 01 01:39:39 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:39 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d" returned: 0 in 0.507s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:39:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f94cbf0-0020-4097-9b0b-19174258885d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6aca9c-8905-49ad-850e-cdf418638a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Volume volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d (4a5a6159-b2ea-4de5-8c7c-f4c53840768d): created successfully Sep 01 01:39:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6aca9c-8905-49ad-850e-cdf418638a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Flow 'volume_create_manager' (403133d7-c57d-4edf-9906-e759a08a5024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e5de7ded-1eaf-4528-990c-1ba82eaa8f20 tempest-ServersNegativeTestJSON-506330979 None] Created volume successfully. Sep 01 01:39:42 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:39:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Flow 'volume_create_manager' (20c7ea5d-f27b-4afd-87ec-c1b342fa0feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897b3d6e-093d-40aa-9bdc-a9721bd6c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897b3d6e-093d-40aa-9bdc-a9721bd6c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1435331137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab76c2c-efd0-4a1d-8ab7-4648463a05ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2c34981a8149beac5e88dcf6dc1ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:43Z,use_quota=True,user_id='9f3f56d84a574cc4874a7efd1f8250ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab73668-4081-4bd3-af3b-379e6f3079de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab73668-4081-4bd3-af3b-379e6f3079de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91785fa-b621-405a-a884-aa2a53d12ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91785fa-b621-405a-a884-aa2a53d12ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab76c2c-efd0-4a1d-8ab7-4648463a05ac', 'volume_name': 'volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a05f76f-a3c7-4d8e-b5c3-dd2e73c9ba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a05f76f-a3c7-4d8e-b5c3-dd2e73c9ba4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55bc3ed-7444-4127-a226-eb04f10a2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Volume eab76c2c-efd0-4a1d-8ab7-4648463a05ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac', 'volume_size': 1} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1435331137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab76c2c-efd0-4a1d-8ab7-4648463a05ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f2c34981a8149beac5e88dcf6dc1ce0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:43Z,use_quota=True,user_id='9f3f56d84a574cc4874a7efd1f8250ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Creating volume eab76c2c-efd0-4a1d-8ab7-4648463a05ac {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:39:43 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:43 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac 1073741824 Sep 01 01:39:43 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:43 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac 1073741824" returned: 0 in 0.580s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:43 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac Sep 01 01:39:43 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:44 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac" returned: 0 in 0.449s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:39:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55bc3ed-7444-4127-a226-eb04f10a2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bae79eb-9704-479b-8530-f5a8dee5062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:44 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Volume volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac (eab76c2c-efd0-4a1d-8ab7-4648463a05ac): created successfully Sep 01 01:39:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bae79eb-9704-479b-8530-f5a8dee5062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Flow 'volume_create_manager' (20c7ea5d-f27b-4afd-87ec-c1b342fa0feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8d2663b3-3876-4cab-8744-9a8cf977df6a tempest-ServersNegativeTestJSON-506330979 None] Created volume successfully. Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "cinder-eab76c2c-efd0-4a1d-8ab7-4648463a05ac-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-eab76c2c-efd0-4a1d-8ab7-4648463a05ac-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "cinder-quobyte-eab76c2c-efd0-4a1d-8ab7-4648463a05ac" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-quobyte-eab76c2c-efd0-4a1d-8ab7-4648463a05ac" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d3a911-d86f-4dbb-a131-b43c3f2ec942]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:45 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac Sep 01 01:39:45 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:45 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac" returned: 0 in 0.441s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:45 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac Sep 01 01:39:45 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:46 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-eab76c2c-efd0-4a1d-8ab7-4648463a05ac" returned: 0 in 0.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-quobyte-eab76c2c-efd0-4a1d-8ab7-4648463a05ac" released by "delete_volume" :: held 0.817s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Created reservations ['536451af-fdba-4343-a7c6-235fd1b21324', '010ac246-b65f-4c06-9745-c008ff4ee75e', 'f1aaaafc-e9c8-4591-9a26-077da2ffc0ca', 'cc1ace09-ff9e-4248-82ca-c3658fb58c73'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:46 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:39:46 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "cinder-4a5a6159-b2ea-4de5-8c7c-f4c53840768d-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-4a5a6159-b2ea-4de5-8c7c-f4c53840768d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Flow 'volume_create_manager' (ae9a9899-4f4a-4ca5-a754-4250e8b2c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6254d0d1-9dcf-45ee-819c-aa78b475fdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6254d0d1-9dcf-45ee-819c-aa78b475fdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2020007539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7259d4d6-5b74-488f-8a58-93d6d064b16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8881899fcda641b9991e8f882bef5d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:47Z,use_quota=True,user_id='ab3c1c7b8228476aa382fcbc1b64590b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df96970-4baf-4a38-891a-59a677de2349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df96970-4baf-4a38-891a-59a677de2349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10453a77-d630-42b9-a78f-cf768ec3dc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10453a77-d630-42b9-a78f-cf768ec3dc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7259d4d6-5b74-488f-8a58-93d6d064b16e', 'volume_name': 'volume-7259d4d6-5b74-488f-8a58-93d6d064b16e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5f3bf8-d33b-4045-ac59-682fe1118e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5f3bf8-d33b-4045-ac59-682fe1118e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ade96-e1cd-45be-8371-4f8d560ba57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:46 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Volume 7259d4d6-5b74-488f-8a58-93d6d064b16e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7259d4d6-5b74-488f-8a58-93d6d064b16e', 'volume_size': 1} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2020007539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7259d4d6-5b74-488f-8a58-93d6d064b16e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8881899fcda641b9991e8f882bef5d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:39:47Z,use_quota=True,user_id='ab3c1c7b8228476aa382fcbc1b64590b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Creating volume 7259d4d6-5b74-488f-8a58-93d6d064b16e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:39:46 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:46 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "cinder-quobyte-4a5a6159-b2ea-4de5-8c7c-f4c53840768d" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.557s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:46 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:39:46 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e 1073741824 Sep 01 01:39:46 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Deleted volume successfully. Sep 01 01:39:46 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-quobyte-4a5a6159-b2ea-4de5-8c7c-f4c53840768d" acquired by "delete_volume" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1298a5bf-181f-4c41-8e2e-a241bd644a4f tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-eab76c2c-efd0-4a1d-8ab7-4648463a05ac-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d727052f-1107-442d-970e-f78dd3037211]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:47 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d Sep 01 01:39:47 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:47 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e 1073741824" returned: 0 in 0.474s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:47 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d" returned: 0 in 0.395s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:47 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d Sep 01 01:39:47 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:47 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e Sep 01 01:39:47 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:47 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a5a6159-b2ea-4de5-8c7c-f4c53840768d" returned: 0 in 0.333s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:47 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e" returned: 0 in 0.315s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-quobyte-4a5a6159-b2ea-4de5-8c7c-f4c53840768d" released by "delete_volume" :: held 0.800s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ade96-e1cd-45be-8371-4f8d560ba57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7259d4d6-5b74-488f-8a58-93d6d064b16e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84766498-fe88-4f28-b9ce-50e1aa25cd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:39:47 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Volume volume-7259d4d6-5b74-488f-8a58-93d6d064b16e (7259d4d6-5b74-488f-8a58-93d6d064b16e): created successfully Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84766498-fe88-4f28-b9ce-50e1aa25cd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Flow 'volume_create_manager' (ae9a9899-4f4a-4ca5-a754-4250e8b2c63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:39:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ec316ce1-dcff-475c-8c81-85d0b2550007 tempest-AttachVolumeShelveTestJSON-1184646919 None] Created volume successfully. Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Created reservations ['f1a192b3-9e89-4402-8db4-dc9268b886e0', '2bca32a4-ae07-4b14-9142-59b813bcd319', 'b814a5d0-57bd-45be-93c6-8764dd55cd35', '4679286b-62f6-44f9-9550-75229693b5f3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:39:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:39:48 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:39:48 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:39:48 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Sep 01 01:39:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.243s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:39:48 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:39:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Deleted volume successfully. Sep 01 01:39:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-26610886-989f-40fa-bddf-41a535a1d063 tempest-ServersNegativeTestJSON-506330979 None] Lock "cinder-4a5a6159-b2ea-4de5-8c7c-f4c53840768d-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:39:57 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:39:58 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=33,cinder:SELECT=23,cinder:DELETE=5,cinder:INSERT=5 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:40:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-a6bde742-2b10-4e83-847c-f41145bf2579 req-a39e73a4-d831-4f5b-8639-5321a2ad3f28 tempest-AttachVolumeShelveTestJSON-1184646919 None] No connector for attachment 47399281-289b-4c0f-ab45-73c09908f28c; skipping storage backend terminate_connection call. {{(pid=87212) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 01:40:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-a6bde742-2b10-4e83-847c-f41145bf2579 req-a39e73a4-d831-4f5b-8639-5321a2ad3f28 tempest-AttachVolumeShelveTestJSON-1184646919 None] Deleting attachment 47399281-289b-4c0f-ab45-73c09908f28c. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:40:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-6dc07167-84c8-4ee2-b150-77aa3bbdb9b7 req-7876bc8e-9578-44bf-a234-578fc18e146a tempest-TaggedAttachmentsTest-1902109829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-6dc07167-84c8-4ee2-b150-77aa3bbdb9b7 req-7876bc8e-9578-44bf-a234-578fc18e146a tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-6dc07167-84c8-4ee2-b150-77aa3bbdb9b7 req-7876bc8e-9578-44bf-a234-578fc18e146a tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-6dc07167-84c8-4ee2-b150-77aa3bbdb9b7 req-7876bc8e-9578-44bf-a234-578fc18e146a tempest-TaggedAttachmentsTest-1902109829 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-a078276c-06d2-44da-a204-2fe40921418f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8253c7a-cd99-4e14-a9d1-a8a80d91e7a5', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:40:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-6dc07167-84c8-4ee2-b150-77aa3bbdb9b7 req-7876bc8e-9578-44bf-a234-578fc18e146a tempest-TaggedAttachmentsTest-1902109829 None] attachment_update completed successfully. Sep 01 01:40:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-12626d3e-078c-4130-80dd-9276c3dab9fd req-4e38aac9-7ef3-4112-b65a-4a684d8f76c0 tempest-TaggedAttachmentsTest-1902109829 None] Terminate volume connection completed successfully. Sep 01 01:40:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-12626d3e-078c-4130-80dd-9276c3dab9fd req-4e38aac9-7ef3-4112-b65a-4a684d8f76c0 tempest-TaggedAttachmentsTest-1902109829 None] Deleting attachment f8253c7a-cd99-4e14-a9d1-a8a80d91e7a5. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:40:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-06b38af3-303e-4ffd-90ae-3b657178cfb4 req-1ca0a817-1e61-48b3-85eb-21ac9038d0f6 tempest-AttachVolumeTestJSON-216990028 None] Terminate volume connection completed successfully. Sep 01 01:40:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-06b38af3-303e-4ffd-90ae-3b657178cfb4 req-1ca0a817-1e61-48b3-85eb-21ac9038d0f6 tempest-AttachVolumeTestJSON-216990028 None] Deleting attachment 9ebf4a8f-5da2-4d78-a8d3-b612ad6a21d3. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:40:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0097dfe4-a0c8-4061-a181-19a658b42398 tempest-GroupsTest-1330944073 None] Group tempest-Group1-155290920: creating Sep 01 01:40:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0097dfe4-a0c8-4061-a181-19a658b42398 tempest-GroupsTest-1330944073 None] Group tempest-Group1-155290920: created successfully Sep 01 01:40:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0097dfe4-a0c8-4061-a181-19a658b42398 tempest-GroupsTest-1330944073 None] Create group completed successfully. Sep 01 01:40:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d73e9b05-1e53-4263-87bf-64d1c1890305 tempest-GroupsTest-1330944073 None] Group tempest-Group2-927219333: creating Sep 01 01:40:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d73e9b05-1e53-4263-87bf-64d1c1890305 tempest-GroupsTest-1330944073 None] Group tempest-Group2-927219333: created successfully Sep 01 01:40:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d73e9b05-1e53-4263-87bf-64d1c1890305 tempest-GroupsTest-1330944073 None] Create group completed successfully. Sep 01 01:40:14 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:40:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Flow 'volume_create_manager' (9ae91e3a-2ca1-47ff-b5ea-cbfc1454fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c2219c-26fa-4f52-b926-c62583c3dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c2219c-26fa-4f52-b926-c62583c3dab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065425476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4aa825e7-5f1f-493c-9b07-e281586d3653,host='devstack@QuobyteHD#QuobyteHD',id=d8aba0ac-5888-4588-a265-e24cf873555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a86a3d36944b5b494502cb346add4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:15Z,use_quota=True,user_id='48a36a459f744fef8fd496f077ce0895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d882c7-eb5d-4f98-a1bd-b4d555406be8),volume_type_id=82d882c7-eb5d-4f98-a1bd-b4d555406be8)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675ae57e-0bf4-47de-81b6-08528d0e83cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675ae57e-0bf4-47de-81b6-08528d0e83cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23a4550-e733-4ad2-9d01-ea4828fecb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23a4550-e733-4ad2-9d01-ea4828fecb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8aba0ac-5888-4588-a265-e24cf873555b', 'volume_name': 'volume-d8aba0ac-5888-4588-a265-e24cf873555b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25030ac3-420a-4911-ab05-82f0b74a6990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25030ac3-420a-4911-ab05-82f0b74a6990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd1cab4-4af0-4e21-ba64-3c3be43c2460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:15 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Volume d8aba0ac-5888-4588-a265-e24cf873555b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8aba0ac-5888-4588-a265-e24cf873555b', 'volume_size': 1} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4aa825e7-5f1f-493c-9b07-e281586d3653,created_at=2026-08-31T23:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1065425476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4aa825e7-5f1f-493c-9b07-e281586d3653,host='devstack@QuobyteHD#QuobyteHD',id=d8aba0ac-5888-4588-a265-e24cf873555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a86a3d36944b5b494502cb346add4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:15Z,use_quota=True,user_id='48a36a459f744fef8fd496f077ce0895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82d882c7-eb5d-4f98-a1bd-b4d555406be8),volume_type_id=82d882c7-eb5d-4f98-a1bd-b4d555406be8)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Creating volume d8aba0ac-5888-4588-a265-e24cf873555b {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:40:15 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:40:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:15 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b 1073741824 Sep 01 01:40:15 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:16 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b 1073741824" returned: 0 in 1.209s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:16 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b Sep 01 01:40:16 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:17 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:40:17 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:17 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b" returned: 0 in 0.872s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd1cab4-4af0-4e21-ba64-3c3be43c2460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8aba0ac-5888-4588-a265-e24cf873555b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc6eaa5-09d1-4e51-843b-2dc5a3cc8cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:17 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Volume volume-d8aba0ac-5888-4588-a265-e24cf873555b (d8aba0ac-5888-4588-a265-e24cf873555b): created successfully Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc6eaa5-09d1-4e51-843b-2dc5a3cc8cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Flow 'volume_create_manager' (9ae91e3a-2ca1-47ff-b5ea-cbfc1454fe71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f086779f-7520-4f97-8653-f7000917a4fa tempest-GroupsTest-1330944073 None] Created volume successfully. Sep 01 01:40:18 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 1.179s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:18 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:40:18 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:40:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 8 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:40:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:40:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Acquiring lock "cinder-quobyte-d8aba0ac-5888-4588-a265-e24cf873555b" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:40:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Lock "cinder-quobyte-d8aba0ac-5888-4588-a265-e24cf873555b" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:40:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a638dc-c08e-465a-9ae7-a5d0285069b3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:40:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:21 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b Sep 01 01:40:21 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:21 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b" returned: 0 in 0.610s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:21 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b Sep 01 01:40:21 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:21 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d8aba0ac-5888-4588-a265-e24cf873555b" returned: 0 in 0.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Lock "cinder-quobyte-d8aba0ac-5888-4588-a265-e24cf873555b" released by "delete_volume" :: held 1.008s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Created reservations ['29da2df3-0b00-4bf5-9bca-4244b0d0e6cd'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:22 devstack cinder-volume[87212]: WARNING cinder.quota [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-364095623 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-364095623, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:40:22 devstack cinder-volume[87212]: WARNING cinder.quota [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-364095623 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-364095623, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Created reservations ['75cb5c6c-1196-49ae-bf33-39c6e1add7c7', 'afcdbe3c-1597-4f98-9d15-f0b18c48ef29', '3bd7fb87-0ca6-4c88-a67a-d5bc6ba4d7b8', 'bba708a3-cd4e-4261-9ed8-dafa0d6b1d9f'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:22 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:40:22 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Created reservations ['450fe102-c78c-4666-ad28-4a1a78b92b5a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:22 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.433s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:22 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:40:22 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-952a5175-bfd7-4327-9ef4-3df00d3cca60 tempest-GroupsTest-1330944073 None] Delete group completed successfully. Sep 01 01:40:22 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:40:22 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:23 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.420s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:23 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:40:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7a04b0e2-c9c2-40e8-8608-15699260e45e tempest-GroupsTest-1330944073 None] Delete group completed successfully. Sep 01 01:40:24 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-58e8de9e-6ed3-4668-a5b4-71811849351e tempest-GroupsTest-1330944073 None] Group tempest-GroupsTest-Group-78828760: creating Sep 01 01:40:24 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-58e8de9e-6ed3-4668-a5b4-71811849351e tempest-GroupsTest-1330944073 None] Group tempest-GroupsTest-Group-78828760: created successfully Sep 01 01:40:24 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-58e8de9e-6ed3-4668-a5b4-71811849351e tempest-GroupsTest-1330944073 None] Create group completed successfully. Sep 01 01:40:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Acquiring lock "cinder-a078276c-06d2-44da-a204-2fe40921418f-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:40:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Lock "cinder-a078276c-06d2-44da-a204-2fe40921418f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:40:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Acquiring lock "cinder-quobyte-a078276c-06d2-44da-a204-2fe40921418f" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:40:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Lock "cinder-quobyte-a078276c-06d2-44da-a204-2fe40921418f" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:40:25 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b8d881-3aaf-428c-8269-68019ba2d7cb]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:40:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:25 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f Sep 01 01:40:25 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:26 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f" returned: 0 in 0.418s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:26 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f Sep 01 01:40:26 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Flow 'volume_create_manager' (53874ee2-4e78-46e4-bfe4-a27f4e42b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d01e02b-ffb7-44fb-aca1-7a0edc87c285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d01e02b-ffb7-44fb-aca1-7a0edc87c285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002093166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=074da722-c82e-4c43-a185-3512b7c4fed3,host='devstack@QuobyteHD#QuobyteHD',id=c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a86a3d36944b5b494502cb346add4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:26Z,use_quota=True,user_id='48a36a459f744fef8fd496f077ce0895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a25cda0-726f-43ff-9ac3-7e485d81f968),volume_type_id=0a25cda0-726f-43ff-9ac3-7e485d81f968)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300f396a-6597-445c-8483-53adef900d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300f396a-6597-445c-8483-53adef900d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4a4dad-2159-4a6d-98b3-b5acbba1ec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4a4dad-2159-4a6d-98b3-b5acbba1ec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a', 'volume_name': 'volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685a7c09-9663-4b44-8921-c6956a3afadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685a7c09-9663-4b44-8921-c6956a3afadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b989f2-1fd5-43e8-ab51-ccbcc1f3a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:26 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Volume c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a', 'volume_size': 1} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=074da722-c82e-4c43-a185-3512b7c4fed3,created_at=2026-08-31T23:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1002093166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=074da722-c82e-4c43-a185-3512b7c4fed3,host='devstack@QuobyteHD#QuobyteHD',id=c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a86a3d36944b5b494502cb346add4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:26Z,use_quota=True,user_id='48a36a459f744fef8fd496f077ce0895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a25cda0-726f-43ff-9ac3-7e485d81f968),volume_type_id=0a25cda0-726f-43ff-9ac3-7e485d81f968)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Creating volume c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:40:26 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:40:26 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a078276c-06d2-44da-a204-2fe40921418f" returned: 0 in 0.404s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:26 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a 1073741824 Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Lock "cinder-quobyte-a078276c-06d2-44da-a204-2fe40921418f" released by "delete_volume" :: held 0.873s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:40:26 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Created reservations ['05571fcd-56c3-472f-9342-7138d9db4af0', '23e9de9f-6b02-4635-bc8b-e744c416efb7', '018959b9-c701-47ab-a91a-e0ccbb00de54', 'bfd5e415-1f98-46b0-bad4-faf8dc49f7c1'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:26 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:40:26 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:27 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.355s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:40:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Deleted volume successfully. Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab34f446-6ce9-4005-9d8d-99f5b0814a3e tempest-TaggedAttachmentsTest-1902109829 None] Lock "cinder-a078276c-06d2-44da-a204-2fe40921418f-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:40:27 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a 1073741824" returned: 0 in 0.725s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:27 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a Sep 01 01:40:27 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:27 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a" returned: 0 in 0.356s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b989f2-1fd5-43e8-ab51-ccbcc1f3a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2a9e4a-3f3c-4e02-8d93-5eb2cf28e422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:27 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Volume volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a (c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a): created successfully Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2a9e4a-3f3c-4e02-8d93-5eb2cf28e422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Flow 'volume_create_manager' (53874ee2-4e78-46e4-bfe4-a27f4e42b125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4e0f2334-1c2e-4081-a6b8-56392f90e24a tempest-GroupsTest-1330944073 None] Created volume successfully. Sep 01 01:40:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:40:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Flow 'volume_create_manager' (488c354c-1576-4bf2-b307-e9b187ead10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033dea4c-02f7-44b2-97bd-4b6d1822d199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033dea4c-02f7-44b2-97bd-4b6d1822d199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-737376692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=074da722-c82e-4c43-a185-3512b7c4fed3,host='devstack@QuobyteHD#QuobyteHD',id=e5f0060a-74a0-4307-9e66-c171689d954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a86a3d36944b5b494502cb346add4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:30Z,use_quota=True,user_id='48a36a459f744fef8fd496f077ce0895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a25cda0-726f-43ff-9ac3-7e485d81f968),volume_type_id=0a25cda0-726f-43ff-9ac3-7e485d81f968)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a003b216-2ce7-4720-b2af-6f6409242b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a003b216-2ce7-4720-b2af-6f6409242b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f15c17b-2c89-44c0-b365-79d68c7c5a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f15c17b-2c89-44c0-b365-79d68c7c5a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f0060a-74a0-4307-9e66-c171689d954e', 'volume_name': 'volume-e5f0060a-74a0-4307-9e66-c171689d954e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bdf00d-a1da-4ee5-b402-016de6aeffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bdf00d-a1da-4ee5-b402-016de6aeffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e2d730-5243-4b70-8fe9-6bcaba9b8fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Volume e5f0060a-74a0-4307-9e66-c171689d954e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f0060a-74a0-4307-9e66-c171689d954e', 'volume_size': 1} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=074da722-c82e-4c43-a185-3512b7c4fed3,created_at=2026-08-31T23:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-737376692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=074da722-c82e-4c43-a185-3512b7c4fed3,host='devstack@QuobyteHD#QuobyteHD',id=e5f0060a-74a0-4307-9e66-c171689d954e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f91a86a3d36944b5b494502cb346add4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:30Z,use_quota=True,user_id='48a36a459f744fef8fd496f077ce0895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a25cda0-726f-43ff-9ac3-7e485d81f968),volume_type_id=0a25cda0-726f-43ff-9ac3-7e485d81f968)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Creating volume e5f0060a-74a0-4307-9e66-c171689d954e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:40:30 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:30 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e 1073741824 Sep 01 01:40:30 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:30 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e 1073741824" returned: 0 in 0.476s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:30 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e Sep 01 01:40:30 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:30 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e" returned: 0 in 0.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e2d730-5243-4b70-8fe9-6bcaba9b8fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f0060a-74a0-4307-9e66-c171689d954e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88e16a0-835c-4f0c-a4d8-8f75b1e4bbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Volume volume-e5f0060a-74a0-4307-9e66-c171689d954e (e5f0060a-74a0-4307-9e66-c171689d954e): created successfully Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88e16a0-835c-4f0c-a4d8-8f75b1e4bbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Flow 'volume_create_manager' (488c354c-1576-4bf2-b307-e9b187ead10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6cf426cb-db63-4c2f-80a5-f908b1e64381 tempest-GroupsTest-1330944073 None] Created volume successfully. Sep 01 01:40:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4d980687-2ca0-4e5f-9e0e-bfb2402ca024 tempest-GroupsTest-1330944073 None] Update group completed successfully. Sep 01 01:40:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-365ca13f-fadc-42b6-bac0-36aa27b30dd9 tempest-GroupsTest-1330944073 None] Update group completed successfully. Sep 01 01:40:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Acquiring lock "cinder-quobyte-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:40:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Lock "cinder-quobyte-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:40:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1472c714-4c59-4eed-bdba-a4f25989aecc]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:40:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:34 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a Sep 01 01:40:34 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:35 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a" returned: 0 in 0.350s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:35 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a Sep 01 01:40:35 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:35 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a" returned: 0 in 0.225s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Lock "cinder-quobyte-c1f7cfe8-3a51-4e0e-9c7f-959e99e4fc2a" released by "delete_volume" :: held 0.608s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Acquiring lock "cinder-quobyte-e5f0060a-74a0-4307-9e66-c171689d954e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Lock "cinder-quobyte-e5f0060a-74a0-4307-9e66-c171689d954e" acquired by "delete_volume" :: waited 0.012s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f20ecc-cabb-49be-a5aa-ca3658b094a4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:35 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e Sep 01 01:40:35 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:35 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e" returned: 0 in 0.413s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:35 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e Sep 01 01:40:35 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e5f0060a-74a0-4307-9e66-c171689d954e" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:36 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Lock "cinder-quobyte-e5f0060a-74a0-4307-9e66-c171689d954e" released by "delete_volume" :: held 0.727s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Created reservations ['0f4fae54-da7f-45f8-b98a-a4524dd7e566'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:36 devstack cinder-volume[87212]: WARNING cinder.quota [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-878003658 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-878003658, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:40:36 devstack cinder-volume[87212]: WARNING cinder.quota [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-878003658 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-878003658, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Created reservations ['61ff42b1-1289-4feb-b0c6-5c6d4a3c8cde', '0a6d64d5-b629-4cb2-900f-f4418c1b79b8', '6aa4bbcf-6042-4dae-baef-3d5ab39c491a', 'd380e1e7-e5b2-49da-88f2-b82e10f52a63'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Created reservations ['cc63556e-a170-43d8-9e79-0de77c3f0f6d', '3f587f65-40b3-4698-b677-824e870c7345', '8c5d8545-22a8-4b22-a381-668897e2d822', 'd5908af1-a0cd-4917-b9a9-d36a22cebc10'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:36 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:40:36 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:36 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.239s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:36 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:40:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c106f163-5043-4deb-93c7-f49b8826cbc6 tempest-GroupsTest-1330944073 None] Delete group completed successfully. Sep 01 01:40:46 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=59,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:40:46 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=53,cinder:UPDATE=59,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:40:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Acquiring lock "cinder-7259d4d6-5b74-488f-8a58-93d6d064b16e-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:40:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "cinder-7259d4d6-5b74-488f-8a58-93d6d064b16e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:40:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Acquiring lock "cinder-quobyte-7259d4d6-5b74-488f-8a58-93d6d064b16e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:40:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "cinder-quobyte-7259d4d6-5b74-488f-8a58-93d6d064b16e" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:40:51 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8946a2cb-6157-4ef7-9e6b-feeec93ce845]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:40:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:52 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e Sep 01 01:40:52 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:52 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e" returned: 0 in 0.460s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:52 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e Sep 01 01:40:52 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:52 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7259d4d6-5b74-488f-8a58-93d6d064b16e" returned: 0 in 0.333s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "cinder-quobyte-7259d4d6-5b74-488f-8a58-93d6d064b16e" released by "delete_volume" :: held 0.866s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Created reservations ['701e7d93-acc4-4efc-b6b8-728f62d1a168', '14288185-4c1f-49f2-ba8e-5000f22a66d6', '67a96c2f-9e02-4978-8a24-412defb001ac', '34031e9a-4305-48cd-9e57-fd3fa80c3045'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:53 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:40:53 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:53 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:53 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:40:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Deleted volume successfully. Sep 01 01:40:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fc86b5de-7950-43ae-adc4-3fc93a11a44f tempest-AttachVolumeShelveTestJSON-1184646919 None] Lock "cinder-7259d4d6-5b74-488f-8a58-93d6d064b16e-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Flow 'volume_create_manager' (b2c7e2a3-7f8c-4cc3-a709-f5aae86c61aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a1b1ff-072e-4c74-a5b1-08c46b92222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a1b1ff-072e-4c74-a5b1-08c46b92222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-679641020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39d28a9-8b24-499d-b6df-208cc6ca9a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1038b650ca24f22a9595dbb9c0566c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:54Z,use_quota=True,user_id='d58ba660f1fd45f2ac5ca8ae3d9a3f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf03a97a-1dce-4aa4-aa94-2317950e9b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf03a97a-1dce-4aa4-aa94-2317950e9b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455a8b94-86ed-446d-9798-7b7674116112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455a8b94-86ed-446d-9798-7b7674116112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39d28a9-8b24-499d-b6df-208cc6ca9a83', 'volume_name': 'volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8467d-c4e8-4b74-bf14-6ead2e7654aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8467d-c4e8-4b74-bf14-6ead2e7654aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026bb8d3-af24-4cdd-8d99-3254881a142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:54 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Volume e39d28a9-8b24-499d-b6df-208cc6ca9a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83', 'volume_size': 1} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-679641020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39d28a9-8b24-499d-b6df-208cc6ca9a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1038b650ca24f22a9595dbb9c0566c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:40:54Z,use_quota=True,user_id='d58ba660f1fd45f2ac5ca8ae3d9a3f06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Creating volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:40:54 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:40:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:54 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 1073741824 Sep 01 01:40:54 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:55 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 1073741824" returned: 0 in 0.650s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:55 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 Sep 01 01:40:55 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:55 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83" returned: 0 in 0.358s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026bb8d3-af24-4cdd-8d99-3254881a142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35747be-5721-4f9a-8d47-1f3bb6217750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:40:55 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Volume volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 (e39d28a9-8b24-499d-b6df-208cc6ca9a83): created successfully Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35747be-5721-4f9a-8d47-1f3bb6217750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:40:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Flow 'volume_create_manager' (b2c7e2a3-7f8c-4cc3-a709-f5aae86c61aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:40:55 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a2a54b39-61be-4bab-bdc3-d6339393994f tempest-SnapshotsActionsTest-493202061 None] Created volume successfully. Sep 01 01:40:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:40:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:40:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Creating offline snapshot 987b902c-9c09-46ab-b581-42918cf63071 of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:40:56 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a258b94a-2999-4267-a804-986a46a13f69]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:40:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:56 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 Sep 01 01:40:56 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:57 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83" returned: 0 in 0.502s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:57 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 1G Sep 01 01:40:57 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:57 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 1G" returned: 0 in 0.573s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:57 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:40:57 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:58 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:58 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 is being set with open permissions: ugo+rw Sep 01 01:40:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:58 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:40:58 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:58 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:58 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.info Sep 01 01:40:58 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:58 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.info" returned: 0 in 0.361s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:58 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.info is being set with open permissions: ugo+rw Sep 01 01:40:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:40:58 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.info Sep 01 01:40:58 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:40:59 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Sep 01 01:40:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.info" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:40:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:40:59 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b5ad9d66-1c10-4547-a8f7-47ab1e5819ea tempest-SnapshotsActionsTest-493202061 None] Create snapshot completed successfully Sep 01 01:41:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Creating offline snapshot 32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:41:00 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1f8186-d9b4-45c9-8fc4-e36409b5e625]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:01 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:01 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:01 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.635s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:01 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a 1G Sep 01 01:41:01 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:02 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a 1G" returned: 0 in 0.870s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:02 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a Sep 01 01:41:02 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:02 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" returned: 0 in 0.550s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:02 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a is being set with open permissions: ugo+rw Sep 01 01:41:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:03 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a Sep 01 01:41:03 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:03 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" returned: 0 in 0.581s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:03 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-99005046-6fa1-4c94-9bf7-4b84939b15d7 tempest-SnapshotsActionsTest-493202061 None] Create snapshot completed successfully Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Deleting offline snapshot 32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] snapshot_file for this snap is: volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48b1c15-6ada-45e4-81d1-56719c7e2919]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:04 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a Sep 01 01:41:04 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:05 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" returned: 0 in 0.869s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:05 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[41937024-b414-4cc3-8832-440ee62331ee]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:05 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:05 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:06 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.900s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:06 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a Sep 01 01:41:06 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:07 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" returned: 0 in 0.956s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:07 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a Sep 01 01:41:07 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:08 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" returned: 0 in 0.579s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a" released by "_delete_snapshot" :: held 3.470s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" released by "delete_snapshot" :: held 3.527s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:08 devstack cinder-volume[87212]: WARNING cinder.quota [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Created reservations ['e725f3d8-c4c8-4082-935b-da47a8081343', '1b30648a-774d-45bf-921e-087d84d3da24', 'd83cf777-e239-443d-b5ea-31821f1a0b86', '313b9b15-d2cf-4593-8448-25cc0255909d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Delete snapshot completed successfully. Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d81f942-e6f7-46ec-8537-f5b3877afd62 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-32caae1f-73c5-4d5d-86cd-7dc3bcb3b67a-delete_snapshot" released by "delete_snapshot" :: held 3.787s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Flow 'volume_create_manager' (76feee66-f4dd-4b19-8779-e8004f8ac277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb899e62-ac87-426b-89b2-d8166feb8bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb899e62-ac87-426b-89b2-d8166feb8bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-127415218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31477e61-8a55-402d-8ad4-91b8f9a7ffad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0600ed03e98b4645bbced28f6de3a38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:09Z,use_quota=True,user_id='32a1c4fc113b4dee8312899ffe4ac384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9fb7a1-78fb-436f-b692-4226c70475fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9fb7a1-78fb-436f-b692-4226c70475fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52082b3-e0ba-4852-a3f4-5b51723193af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a52082b3-e0ba-4852-a3f4-5b51723193af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31477e61-8a55-402d-8ad4-91b8f9a7ffad', 'volume_name': 'volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1c4d97-c554-46e3-a7fc-57a0b54a79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc1c4d97-c554-46e3-a7fc-57a0b54a79c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2751c42c-60d4-4dc1-8e88-19e1c659812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:09 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Volume 31477e61-8a55-402d-8ad4-91b8f9a7ffad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad', 'volume_size': 1} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-127415218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31477e61-8a55-402d-8ad4-91b8f9a7ffad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0600ed03e98b4645bbced28f6de3a38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:09Z,use_quota=True,user_id='32a1c4fc113b4dee8312899ffe4ac384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Creating volume 31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:41:09 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:09 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad 1073741824 Sep 01 01:41:09 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:10 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad 1073741824" returned: 0 in 0.950s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:10 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad Sep 01 01:41:10 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:10 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad" returned: 0 in 0.375s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.538s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2751c42c-60d4-4dc1-8e88-19e1c659812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd82adb-15ea-4057-83c8-d9bf0624e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Creating offline snapshot e8da43fa-e94c-4523-a2d9-a34d58895653 of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:41:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Volume volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad (31477e61-8a55-402d-8ad4-91b8f9a7ffad): created successfully Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd82adb-15ea-4057-83c8-d9bf0624e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Flow 'volume_create_manager' (76feee66-f4dd-4b19-8779-e8004f8ac277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bdb02a-948f-45b0-b908-520ebd92aafb]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-67c341e5-33de-4143-a803-1eb3da4f3e76 req-c205bf7d-65f8-429f-953e-ae2427567191 tempest-VolumesSnapshotsTestJSON-1551415659 None] Created volume successfully. Sep 01 01:41:10 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:10 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:11 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.555s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:11 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 1G Sep 01 01:41:11 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:11 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 1G" returned: 0 in 0.738s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:11 devstack sudo[91829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 Sep 01 01:41:11 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:12 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653" returned: 0 in 0.353s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:12 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 is being set with open permissions: ugo+rw Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:12 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 Sep 01 01:41:12 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:12 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.088s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Creating offline snapshot 08d54ca2-c032-4efe-a34c-28d94712573f of volume 31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:41:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8dc20f94-6e4a-4238-b03d-e52c8dea26cf tempest-SnapshotsActionsTest-493202061 None] Create snapshot completed successfully Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7502ba4-7efa-42eb-b3fb-7cb9b7c17fff]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:12 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad Sep 01 01:41:12 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:13 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad" returned: 0 in 0.508s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:13 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f 1G Sep 01 01:41:13 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-e8da43fa-e94c-4523-a2d9-a34d58895653-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-e8da43fa-e94c-4523-a2d9-a34d58895653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-e8da43fa-e94c-4523-a2d9-a34d58895653" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e8da43fa-e94c-4523-a2d9-a34d58895653" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Deleting offline snapshot e8da43fa-e94c-4523-a2d9-a34d58895653 of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] snapshot_file for this snap is: volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8da6d06-a7c5-498d-8b73-4b23506c878f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:13 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 Sep 01 01:41:13 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:13 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f 1G" returned: 0 in 0.622s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:13 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f Sep 01 01:41:13 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:13 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653" returned: 0 in 0.516s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d0716b-b8e2-4009-9619-1be240698cca]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:14 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f" returned: 0 in 0.406s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:14 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f is being set with open permissions: ugo+rw Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:14 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f Sep 01 01:41:14 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:14 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:14 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:14 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f" returned: 0 in 0.325s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:14 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.460s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:14 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 Sep 01 01:41:14 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:14 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.info Sep 01 01:41:14 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:14 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.info" returned: 0 in 0.301s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:14 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.info is being set with open permissions: ugo+rw Sep 01 01:41:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:14 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.info Sep 01 01:41:14 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:15 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653" returned: 0 in 0.549s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:15 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653 Sep 01 01:41:15 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:15 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.info" returned: 0 in 0.328s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-2e5d6475-b0ac-462e-b0d5-9ab693abd3fa req-7086cb5b-ebac-4d8a-b87b-d1510944346f tempest-VolumesSnapshotsTestJSON-1551415659 None] Create snapshot completed successfully Sep 01 01:41:15 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.e8da43fa-e94c-4523-a2d9-a34d58895653" returned: 0 in 0.313s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e8da43fa-e94c-4523-a2d9-a34d58895653" released by "_delete_snapshot" :: held 1.952s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" released by "delete_snapshot" :: held 1.993s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Created reservations ['953e7c78-2b86-42f0-95b4-29d520ab17a5', '87b9c81d-c1a6-4cb5-a3a1-7aad8af52f3e', '298ee2fa-242c-42b8-a76f-e6e21c0cb765', 'a709c76f-9532-49ca-8148-a0fcab4700df'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Delete snapshot completed successfully. Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f32268d-7d62-4743-a98e-55168e901f39 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-e8da43fa-e94c-4523-a2d9-a34d58895653-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Creating offline snapshot 10af3fa0-de18-491b-9c04-15e97b6bf40e of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef1032-16e4-45c1-9274-79cec842d2e3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:16 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:16 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "cinder-08d54ca2-c032-4efe-a34c-28d94712573f-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-08d54ca2-c032-4efe-a34c-28d94712573f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "cinder-quobyte-31477e61-8a55-402d-8ad4-91b8f9a7ffad" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-quobyte-31477e61-8a55-402d-8ad4-91b8f9a7ffad" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "cinder-quobyte-08d54ca2-c032-4efe-a34c-28d94712573f" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-quobyte-08d54ca2-c032-4efe-a34c-28d94712573f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Deleting offline snapshot 08d54ca2-c032-4efe-a34c-28d94712573f of volume 31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] snapshot_file for this snap is: volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7bc91-d47a-46a6-84ab-426da2b5765d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:16 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.563s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:16 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f Sep 01 01:41:16 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:16 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e 1G Sep 01 01:41:16 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:16 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f" returned: 0 in 0.372s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[35218739-409c-4105-aa11-8acbc014c4de]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:17 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad Sep 01 01:41:17 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:17 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:17 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:17 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e 1G" returned: 0 in 0.623s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:17 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e Sep 01 01:41:17 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:17 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad" returned: 0 in 0.591s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:17 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f Sep 01 01:41:17 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:17 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.499s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 8 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:41:17 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e" returned: 0 in 0.438s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:17 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e is being set with open permissions: ugo+rw Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:17 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e Sep 01 01:41:17 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:17 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f" returned: 0 in 0.432s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:17 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f Sep 01 01:41:17 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:17 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e" returned: 0 in 0.301s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-25a8f1f5-83ee-43db-a6a6-ce653add660b tempest-SnapshotsActionsTest-493202061 None] Create snapshot completed successfully Sep 01 01:41:18 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad.08d54ca2-c032-4efe-a34c-28d94712573f" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-quobyte-08d54ca2-c032-4efe-a34c-28d94712573f" released by "_delete_snapshot" :: held 1.766s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-quobyte-31477e61-8a55-402d-8ad4-91b8f9a7ffad" released by "delete_snapshot" :: held 1.814s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.quota [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Created reservations ['e83d2672-3507-4eab-8f1d-5442aa07bdec', '9afb844c-1afc-4a42-bb02-139582970230', '71c1b9ee-f4bb-4a67-9aa1-7f649b3aab2f', '7bf92751-dc51-4f21-8384-f78e6a86c16c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Delete snapshot completed successfully. Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-9523f329-87db-46a5-a8b7-86980651eef0 req-c45e786b-cc9d-4daf-bc3a-b3f1d537b520 tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-08d54ca2-c032-4efe-a34c-28d94712573f-delete_snapshot" released by "delete_snapshot" :: held 1.967s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "cinder-31477e61-8a55-402d-8ad4-91b8f9a7ffad-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-31477e61-8a55-402d-8ad4-91b8f9a7ffad-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "cinder-quobyte-31477e61-8a55-402d-8ad4-91b8f9a7ffad" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-quobyte-31477e61-8a55-402d-8ad4-91b8f9a7ffad" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a37d05-4377-4c13-be81-63ca78e9f2b7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:18 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad Sep 01 01:41:18 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:19 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad" returned: 0 in 0.389s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:19 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad Sep 01 01:41:19 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-10af3fa0-de18-491b-9c04-15e97b6bf40e-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-10af3fa0-de18-491b-9c04-15e97b6bf40e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-10af3fa0-de18-491b-9c04-15e97b6bf40e" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-10af3fa0-de18-491b-9c04-15e97b6bf40e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Deleting offline snapshot 10af3fa0-de18-491b-9c04-15e97b6bf40e of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] snapshot_file for this snap is: volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cef4a85-e683-443c-9572-bb326cd2d2f4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:19 devstack sudo[91957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e Sep 01 01:41:19 devstack sudo[91957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:19 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-31477e61-8a55-402d-8ad4-91b8f9a7ffad" returned: 0 in 0.294s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-quobyte-31477e61-8a55-402d-8ad4-91b8f9a7ffad" released by "delete_volume" :: held 0.760s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.quota [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Created reservations ['a126a39f-bee3-4eb2-8010-52b860328d94', '42edd625-1a63-498d-81c4-2518d8329c52', '5e1256cc-232a-4984-b942-fc4c070f423e', 'c1b4cd55-63a5-442d-b180-90701bf6c37e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:19 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:19 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:19 devstack sudo[91957]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc55c2af-9824-4332-affd-985ff9e0edbf]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:19 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:19 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:19 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.manager [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:19 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Deleted volume successfully. Sep 01 01:41:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-54d8a9fa-697b-4ab9-911c-176d039830f1 req-f02267f6-3263-49df-b9f5-527d6ae49c4c tempest-VolumesSnapshotsTestJSON-1551415659 None] Lock "cinder-31477e61-8a55-402d-8ad4-91b8f9a7ffad-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:20 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.425s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:20 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e Sep 01 01:41:20 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:20 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e" returned: 0 in 0.464s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:20 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e Sep 01 01:41:20 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:20 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.10af3fa0-de18-491b-9c04-15e97b6bf40e" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-10af3fa0-de18-491b-9c04-15e97b6bf40e" released by "_delete_snapshot" :: held 1.679s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" released by "delete_snapshot" :: held 1.710s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Created reservations ['ef3d108f-9aa3-4773-b5c1-fee3ed8bfe45', '47709b45-7225-493b-8088-55467f8b940f', '9b4443c2-d7b6-4df6-a32f-9bf51a95c620', '74c832d0-0000-4e32-8664-0170ba3a0a6d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Delete snapshot completed successfully. Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e72d9648-7356-476d-8b2f-8c7e27fa0834 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-10af3fa0-de18-491b-9c04-15e97b6bf40e-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Creating offline snapshot 5f1da58a-1b1c-42fd-9e25-af40dfaae4bd of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[81120f4d-5b85-4726-9da1-639f64ef2b73]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:21 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:21 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:22 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.373s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:22 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd 1G Sep 01 01:41:22 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:22 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd 1G" returned: 0 in 0.413s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:22 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd Sep 01 01:41:22 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:22 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:22 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd is being set with open permissions: ugo+rw Sep 01 01:41:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:22 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd Sep 01 01:41:22 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:23 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" returned: 0 in 0.255s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.449s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0b24e387-dcaf-484e-9283-64255aa10e84 tempest-SnapshotsActionsTest-493202061 None] Create snapshot completed successfully Sep 01 01:41:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5cc7b790-db28-45d0-a8ec-0a39384cede7 tempest-BackendsCapabilitiesAdminTestsJSON-1279660689 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0979270935059, 'free_capacity_gb': 1774.0979270935059, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87212) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b91a278b-c47a-4c78-be94-dbe534830505 tempest-BackendsCapabilitiesAdminTestsJSON-1279660689 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0979270935059, 'free_capacity_gb': 1774.0979270935059, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87212) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-5f1da58a-1b1c-42fd-9e25-af40dfaae4bd-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-5f1da58a-1b1c-42fd-9e25-af40dfaae4bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Acquiring lock "cinder-quobyte-5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Deleting offline snapshot 5f1da58a-1b1c-42fd-9e25-af40dfaae4bd of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] snapshot_file for this snap is: volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[799b71c0-7daf-4e85-9abf-fd3a12ce95d4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:24 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd Sep 01 01:41:24 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:24 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" returned: 0 in 0.439s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cac4205-d938-46b4-8456-2f1ad162e8a5]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:24 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:24 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:25 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.442s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:25 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd Sep 01 01:41:25 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:25 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" returned: 0 in 0.456s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:25 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd Sep 01 01:41:25 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:25 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-5f1da58a-1b1c-42fd-9e25-af40dfaae4bd" released by "_delete_snapshot" :: held 1.739s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" released by "delete_snapshot" :: held 1.776s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:25 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Created reservations ['d25f1cd5-1373-42f5-aa33-315256d15ebf', '14687638-bdd2-4bde-a18e-03655a5696a5', 'f4df6945-c170-43f5-bf21-c2d5a36b98a2', '8224a675-2211-45d2-aed1-ca332436e710'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:26 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Delete snapshot completed successfully. Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3d612f7-68d8-4d18-8ee0-1ab8da4bf633 tempest-SnapshotsActionsTest-1555980039 None] Lock "cinder-5f1da58a-1b1c-42fd-9e25-af40dfaae4bd-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "cinder-987b902c-9c09-46ab-b581-42918cf63071-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-987b902c-9c09-46ab-b581-42918cf63071-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "cinder-quobyte-987b902c-9c09-46ab-b581-42918cf63071" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-quobyte-987b902c-9c09-46ab-b581-42918cf63071" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Deleting offline snapshot 987b902c-9c09-46ab-b581-42918cf63071 of volume e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] snapshot_file for this snap is: volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d3905c-a90b-4210-a14b-2c282346242d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:26 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:26 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:27 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.391s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9828f509-96a3-45a0-9093-51634f5e6b99]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:27 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 Sep 01 01:41:27 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:27 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83" returned: 0 in 0.364s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:27 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:27 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:27 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:27 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071 Sep 01 01:41:27 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:28 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83.987b902c-9c09-46ab-b581-42918cf63071" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-quobyte-987b902c-9c09-46ab-b581-42918cf63071" released by "_delete_snapshot" :: held 1.603s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" released by "delete_snapshot" :: held 1.623s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Created reservations ['cb618192-90c9-45c9-a26e-d0c9b3668010', '6570150f-ea5d-4ffa-8bb4-de417fb3ef36', '7b552451-d21a-4709-aadf-c40018eedf95', '096c551c-6948-4c7c-885c-4b3a422fd1a0'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:28 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Delete snapshot completed successfully. Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Flow 'volume_create_manager' (0d8db9c5-1f03-42cd-a1a5-2bea4258a597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfb1534-07c9-4fb2-a3d0-ca3caf65ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-57f71bd3-9ac1-4579-bb1c-09a56ecc4f78 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-987b902c-9c09-46ab-b581-42918cf63071-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfb1534-07c9-4fb2-a3d0-ca3caf65ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1522418300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eabd475-2360-41c5-9f7e-e61d651de83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b42c9be04c4692316833c98db7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:28Z,use_quota=True,user_id='9bac913bdadb4f729656678e4132a720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5864d8-82ea-4d44-85e8-6d326ae4e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5864d8-82ea-4d44-85e8-6d326ae4e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc95dcf-cea7-450e-a7d6-d4bd99f1b085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc95dcf-cea7-450e-a7d6-d4bd99f1b085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eabd475-2360-41c5-9f7e-e61d651de83f', 'volume_name': 'volume-6eabd475-2360-41c5-9f7e-e61d651de83f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a3ef62-5a6e-494b-8698-3985c1df1664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a3ef62-5a6e-494b-8698-3985c1df1664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29c8050-ba20-4dc1-8e41-e350176d4fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Volume 6eabd475-2360-41c5-9f7e-e61d651de83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eabd475-2360-41c5-9f7e-e61d651de83f', 'volume_size': 1} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1522418300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eabd475-2360-41c5-9f7e-e61d651de83f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b42c9be04c4692316833c98db7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:28Z,use_quota=True,user_id='9bac913bdadb4f729656678e4132a720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Creating volume 6eabd475-2360-41c5-9f7e-e61d651de83f {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:41:28 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:28 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f 1073741824 Sep 01 01:41:28 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "cinder-e39d28a9-8b24-499d-b6df-208cc6ca9a83-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-e39d28a9-8b24-499d-b6df-208cc6ca9a83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[031611bc-d5d6-4f91-8349-9b9c2c5d9a2b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:29 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f 1073741824" returned: 0 in 0.536s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:29 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f Sep 01 01:41:29 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:29 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 Sep 01 01:41:29 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:29 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f" returned: 0 in 0.338s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29c8050-ba20-4dc1-8e41-e350176d4fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eabd475-2360-41c5-9f7e-e61d651de83f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a4d208-dd77-4495-8e8a-d793ab5700ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83" returned: 0 in 0.439s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:29 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Volume volume-6eabd475-2360-41c5-9f7e-e61d651de83f (6eabd475-2360-41c5-9f7e-e61d651de83f): created successfully Sep 01 01:41:29 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83 Sep 01 01:41:29 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a4d208-dd77-4495-8e8a-d793ab5700ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Flow 'volume_create_manager' (0d8db9c5-1f03-42cd-a1a5-2bea4258a597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5d9c9c9c-2422-4a4d-a755-9b1d0990b77c tempest-AttachVolumeTestJSON-216990028 None] Created volume successfully. Sep 01 01:41:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-aca7198d-570a-4add-a000-9aeaa1ba8c59 tempest-GroupSnapshotsV319Test-1561643480 None] Group tempest-GroupSnapshotsV319Test-Group-1090035914: creating Sep 01 01:41:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-aca7198d-570a-4add-a000-9aeaa1ba8c59 tempest-GroupSnapshotsV319Test-1561643480 None] Group tempest-GroupSnapshotsV319Test-Group-1090035914: created successfully Sep 01 01:41:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-aca7198d-570a-4add-a000-9aeaa1ba8c59 tempest-GroupSnapshotsV319Test-1561643480 None] Create group completed successfully. Sep 01 01:41:29 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e39d28a9-8b24-499d-b6df-208cc6ca9a83" returned: 0 in 0.261s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-quobyte-e39d28a9-8b24-499d-b6df-208cc6ca9a83" released by "delete_volume" :: held 0.770s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Created reservations ['399f54ec-2b3f-4cdb-86cf-eeafac504d0d', '268daa91-48c7-470b-9389-9caeab6f0eef', 'a05698ff-ac2f-42c7-b230-065492389881', '9296f26d-4d0c-463f-b529-c20c3fad457c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:29 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:29 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:30 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.230s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:30 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Deleted volume successfully. Sep 01 01:41:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d132e1e-4293-44ac-9c1c-fecebd784fb9 tempest-SnapshotsActionsTest-493202061 None] Lock "cinder-e39d28a9-8b24-499d-b6df-208cc6ca9a83-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Flow 'volume_create_manager' (c419c453-91f1-47d4-8ae8-de45a1987f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69e8fef-e656-4007-86b7-4827593210dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69e8fef-e656-4007-86b7-4827593210dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-463586311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae542631-f3f3-48ce-bfe8-3e1cbf34cad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbb5147abf724724a5f92df7f3973c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:31Z,use_quota=True,user_id='18f244b7436e4313b90d1a930f3473fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5433a819-96bc-4f2d-83d4-ae2039ac24c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5433a819-96bc-4f2d-83d4-ae2039ac24c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decb0098-923d-4574-9ba2-6e8966745030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (decb0098-923d-4574-9ba2-6e8966745030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae542631-f3f3-48ce-bfe8-3e1cbf34cad6', 'volume_name': 'volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591c7e76-2cd5-4a11-a1c3-dee84e0480ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591c7e76-2cd5-4a11-a1c3-dee84e0480ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1ddb81-3482-4a08-9e34-8ab3f1769f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:31 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Volume ae542631-f3f3-48ce-bfe8-3e1cbf34cad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6', 'volume_size': 1} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-463586311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae542631-f3f3-48ce-bfe8-3e1cbf34cad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbb5147abf724724a5f92df7f3973c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:31Z,use_quota=True,user_id='18f244b7436e4313b90d1a930f3473fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Creating volume ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:41:31 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:31 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 1073741824 Sep 01 01:41:31 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-1b32a241-e219-4a03-a3a7-77e7d6c8ef28 req-be6d7759-688f-4b28-93c6-dfa9e64d00e5 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Flow 'volume_create_manager' (15f6b41f-b38d-47cd-9d77-6a10f61f134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585c937f-42a2-470c-bf0d-dc2bf849b743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585c937f-42a2-470c-bf0d-dc2bf849b743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572650820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51dc8a7e-4b52-4767-8c27-6e61161ce8c1,host='devstack@QuobyteHD#QuobyteHD',id=ab2176f2-b852-4a7a-94df-f843b78ef745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f544e83565f41d7a9b73092af8e40b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:32Z,use_quota=True,user_id='879cf146f6854ec58f0fce2f14b9ff89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaac2450-f70b-4e0a-a63b-13b5d053a40b),volume_type_id=eaac2450-f70b-4e0a-a63b-13b5d053a40b)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81486d6-798f-474e-9707-ebe574e73a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d81486d6-798f-474e-9707-ebe574e73a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a5f80-3e2c-4063-a947-87b27b350497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a5f80-3e2c-4063-a947-87b27b350497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2176f2-b852-4a7a-94df-f843b78ef745', 'volume_name': 'volume-ab2176f2-b852-4a7a-94df-f843b78ef745', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2298dc79-1e90-4991-ab83-c9b07bf9fe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2298dc79-1e90-4991-ab83-c9b07bf9fe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b975d1-b9aa-46ec-9eaa-cb688172e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Volume ab2176f2-b852-4a7a-94df-f843b78ef745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2176f2-b852-4a7a-94df-f843b78ef745', 'volume_size': 1} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:32 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 1073741824" returned: 0 in 0.475s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:32 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 Sep 01 01:41:32 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:32 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6" returned: 0 in 0.313s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-1b32a241-e219-4a03-a3a7-77e7d6c8ef28 req-be6d7759-688f-4b28-93c6-dfa9e64d00e5 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.785s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1ddb81-3482-4a08-9e34-8ab3f1769f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e461fc-939b-42e7-82e9-eec67abb3767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-1b32a241-e219-4a03-a3a7-77e7d6c8ef28 req-be6d7759-688f-4b28-93c6-dfa9e64d00e5 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51dc8a7e-4b52-4767-8c27-6e61161ce8c1,created_at=2026-08-31T23:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572650820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51dc8a7e-4b52-4767-8c27-6e61161ce8c1,host='devstack@QuobyteHD#QuobyteHD',id=ab2176f2-b852-4a7a-94df-f843b78ef745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f544e83565f41d7a9b73092af8e40b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:32Z,use_quota=True,user_id='879cf146f6854ec58f0fce2f14b9ff89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaac2450-f70b-4e0a-a63b-13b5d053a40b),volume_type_id=eaac2450-f70b-4e0a-a63b-13b5d053a40b)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Creating volume ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:41:32 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Volume volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 (ae542631-f3f3-48ce-bfe8-3e1cbf34cad6): created successfully Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e461fc-939b-42e7-82e9-eec67abb3767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:32 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 1073741824 Sep 01 01:41:32 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Flow 'volume_create_manager' (c419c453-91f1-47d4-8ae8-de45a1987f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ef27659d-320f-42ef-b12d-541bee4b5dfa tempest-ServerActionsTestOtherA-2144573553 None] Created volume successfully. Sep 01 01:41:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-1b32a241-e219-4a03-a3a7-77e7d6c8ef28 req-be6d7759-688f-4b28-93c6-dfa9e64d00e5 tempest-AttachVolumeTestJSON-216990028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-6eabd475-2360-41c5-9f7e-e61d651de83f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '591c1681-1a06-42d8-8f3d-257941c83995', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:41:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-1b32a241-e219-4a03-a3a7-77e7d6c8ef28 req-be6d7759-688f-4b28-93c6-dfa9e64d00e5 tempest-AttachVolumeTestJSON-216990028 None] attachment_update completed successfully. Sep 01 01:41:33 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 1073741824" returned: 0 in 0.597s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:33 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 Sep 01 01:41:33 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:33 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745" returned: 0 in 0.366s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b975d1-b9aa-46ec-9eaa-cb688172e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2176f2-b852-4a7a-94df-f843b78ef745', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4e01c3-fdeb-4e81-8701-68baacb31710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:33 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Volume volume-ab2176f2-b852-4a7a-94df-f843b78ef745 (ab2176f2-b852-4a7a-94df-f843b78ef745): created successfully Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4e01c3-fdeb-4e81-8701-68baacb31710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Flow 'volume_create_manager' (15f6b41f-b38d-47cd-9d77-6a10f61f134c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b7da2feb-e6dc-4ad1-a88b-1f22efad546d tempest-GroupSnapshotsV319Test-1561643480 None] Created volume successfully. Sep 01 01:41:34 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] GroupSnapshot 450db22f-dea9-4657-878b-e4c820b2b9f3: creating. Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Group snapshot 450db22f-dea9-4657-878b-e4c820b2b9f3: creating. {{(pid=87212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Creating offline snapshot c7b59b4e-93f1-4f20-a48a-b77ada1b1521 of volume ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2e7c1b-0ba2-45c6-bd07-e61c324a2ee1]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:34 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 Sep 01 01:41:34 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:34 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745" returned: 0 in 0.436s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:34 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 1G Sep 01 01:41:34 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:35 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 1G" returned: 0 in 0.525s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2176f2-b852-4a7a-94df-f843b78ef745 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:35 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2176f2-b852-4a7a-94df-f843b78ef745 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 Sep 01 01:41:35 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Flow 'volume_create_manager' (cf965036-c501-4c8b-9e3b-8989460634c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601c6081-347e-424a-a7cd-6d1359ebdfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:35 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2176f2-b852-4a7a-94df-f843b78ef745 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521" returned: 0 in 0.393s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:35 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601c6081-347e-424a-a7cd-6d1359ebdfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-179172638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371b5ba7-3864-42d2-96af-75cc2a66d9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b42c9be04c4692316833c98db7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:36Z,use_quota=True,user_id='9bac913bdadb4f729656678e4132a720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:35 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3610773f-6d95-44c7-b4de-94e936d2609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:35 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3610773f-6d95-44c7-b4de-94e936d2609a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f66f2d6-86c0-4c69-a856-bb6e9beb2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f66f2d6-86c0-4c69-a856-bb6e9beb2b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371b5ba7-3864-42d2-96af-75cc2a66d9bb', 'volume_name': 'volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fed6982-2a62-4551-95f4-c87905ff1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fed6982-2a62-4551-95f4-c87905ff1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69982489-b234-4e93-841a-bde77765074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:35 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Volume 371b5ba7-3864-42d2-96af-75cc2a66d9bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb', 'volume_size': 1} Sep 01 01:41:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:36 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521" returned: 0 in 0.299s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:36 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.info Sep 01 01:41:36 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:36 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.info" returned: 0 in 0.290s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:36 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:36 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.info Sep 01 01:41:36 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:36 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.info" returned: 0 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-179172638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371b5ba7-3864-42d2-96af-75cc2a66d9bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa34b42c9be04c4692316833c98db7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:36Z,use_quota=True,user_id='9bac913bdadb4f729656678e4132a720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Creating volume 371b5ba7-3864-42d2-96af-75cc2a66d9bb {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:41:36 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:41:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:36 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb 1073741824 Sep 01 01:41:36 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8c7c8de3-9dad-4d69-86e2-a33d7de08335 tempest-GroupSnapshotsV319Test-1561643480 None] group_snapshot 450db22f-dea9-4657-878b-e4c820b2b9f3: created successfully Sep 01 01:41:37 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb 1073741824" returned: 0 in 0.477s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:37 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb Sep 01 01:41:37 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:37 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb" returned: 0 in 0.316s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69982489-b234-4e93-841a-bde77765074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797fc907-a2b7-4a7d-855b-b88ccacc2a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:37 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Volume volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb (371b5ba7-3864-42d2-96af-75cc2a66d9bb): created successfully Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797fc907-a2b7-4a7d-855b-b88ccacc2a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Flow 'volume_create_manager' (cf965036-c501-4c8b-9e3b-8989460634c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:37 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-58ccc833-e8b9-4dde-bd1a-99f447cfe1d3 tempest-AttachVolumeTestJSON-216990028 None] Created volume successfully. Sep 01 01:41:38 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] group_snapshot 450db22f-dea9-4657-878b-e4c820b2b9f3: deleting Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] group_snapshot 450db22f-dea9-4657-878b-e4c820b2b9f3: deleting {{(pid=87212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Acquiring lock "cinder-quobyte-ab2176f2-b852-4a7a-94df-f843b78ef745" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "cinder-quobyte-ab2176f2-b852-4a7a-94df-f843b78ef745" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Acquiring lock "cinder-quobyte-c7b59b4e-93f1-4f20-a48a-b77ada1b1521" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "cinder-quobyte-c7b59b4e-93f1-4f20-a48a-b77ada1b1521" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Deleting offline snapshot c7b59b4e-93f1-4f20-a48a-b77ada1b1521 of volume ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] snapshot_file for this snap is: volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[177a7b82-eb86-4459-9d7e-e57ccd67c544]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:38 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 Sep 01 01:41:38 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-a1d2d381-3a3d-4c39-afb4-4c78924d7b7e req-0d4fd6f8-e56c-422b-b9a7-bdaea519eefe tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-a1d2d381-3a3d-4c39-afb4-4c78924d7b7e req-0d4fd6f8-e56c-422b-b9a7-bdaea519eefe tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-a1d2d381-3a3d-4c39-afb4-4c78924d7b7e req-0d4fd6f8-e56c-422b-b9a7-bdaea519eefe tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:39 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521" returned: 0 in 0.726s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab2176f2-b852-4a7a-94df-f843b78ef745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-a1d2d381-3a3d-4c39-afb4-4c78924d7b7e req-0d4fd6f8-e56c-422b-b9a7-bdaea519eefe tempest-AttachVolumeTestJSON-216990028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03626d43-dbd1-42c4-997e-00f1955e1cc6', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[026b5584-3f49-4a36-a219-bef6fd3ee40a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-a1d2d381-3a3d-4c39-afb4-4c78924d7b7e req-0d4fd6f8-e56c-422b-b9a7-bdaea519eefe tempest-AttachVolumeTestJSON-216990028 None] attachment_update completed successfully. Sep 01 01:41:39 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 Sep 01 01:41:39 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:39 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745" returned: 0 in 0.436s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:39 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 Sep 01 01:41:39 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:40 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521" returned: 0 in 0.463s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:40 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521 Sep 01 01:41:40 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:40 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745.c7b59b4e-93f1-4f20-a48a-b77ada1b1521" returned: 0 in 0.547s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "cinder-quobyte-c7b59b4e-93f1-4f20-a48a-b77ada1b1521" released by "_delete_snapshot" :: held 2.324s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "cinder-quobyte-ab2176f2-b852-4a7a-94df-f843b78ef745" released by "delete_snapshot" :: held 2.369s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:40 devstack cinder-volume[87212]: WARNING cinder.quota [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1732792872 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1732792872, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:41:40 devstack cinder-volume[87212]: WARNING cinder.quota [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1732792872 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1732792872, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:41:40 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] Created reservations ['a209c056-54a8-4198-86b4-c7fcfa9d2345', '61d0eca1-02d3-4ca3-82f2-7c6a53c6b48d', '44bf3b9a-00db-4a19-a36b-86a4facc2964', '4b6608f5-49bf-4742-9498-b25c3eef77e7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:40 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1ffc82d6-b5ab-4670-8a9d-923c98ba71c4 tempest-GroupSnapshotsV319Test-1561643480 None] group_snapshot 450db22f-dea9-4657-878b-e4c820b2b9f3: deleted successfully Sep 01 01:41:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-5579ccba-96a6-41c8-b85f-787a42e34425 req-ad0d4987-ac89-4b92-aab9-ba2d9c4d0672 tempest-AttachVolumeTestJSON-216990028 None] Terminate volume connection completed successfully. Sep 01 01:41:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-5579ccba-96a6-41c8-b85f-787a42e34425 req-ad0d4987-ac89-4b92-aab9-ba2d9c4d0672 tempest-AttachVolumeTestJSON-216990028 None] Deleting attachment 591c1681-1a06-42d8-8f3d-257941c83995. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:41:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Acquiring lock "cinder-quobyte-ab2176f2-b852-4a7a-94df-f843b78ef745" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "cinder-quobyte-ab2176f2-b852-4a7a-94df-f843b78ef745" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfe907a-88e6-4428-b629-2f2e659df389]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:42 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 Sep 01 01:41:42 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:42 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745" returned: 0 in 0.568s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:43 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745 Sep 01 01:41:43 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:43 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ab2176f2-b852-4a7a-94df-f843b78ef745" returned: 0 in 0.513s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "cinder-quobyte-ab2176f2-b852-4a7a-94df-f843b78ef745" released by "delete_volume" :: held 1.202s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:43 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Created reservations ['9f2eb0a7-9f69-441c-84eb-776f136dfa60'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:43 devstack cinder-volume[87212]: WARNING cinder.quota [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1732792872 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1732792872, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:41:43 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Created reservations ['9a671143-3b5f-454b-8a60-ea391b306f7b', '63e6973d-634b-429e-9ec5-d8dceece4a30', 'ac094eb6-4165-4815-abb6-8355dd082d66', 'b5957179-41f6-4f2c-bc8c-b9b1f8635ead'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-9a1dca9d-ca4d-467b-9d39-19b17c7f6fd8 req-06b887b7-b804-4a30-b31b-737d8fc5fcb4 tempest-AttachVolumeTestJSON-216990028 None] Terminate volume connection completed successfully. Sep 01 01:41:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-9a1dca9d-ca4d-467b-9d39-19b17c7f6fd8 req-06b887b7-b804-4a30-b31b-737d8fc5fcb4 tempest-AttachVolumeTestJSON-216990028 None] Deleting attachment 03626d43-dbd1-42c4-997e-00f1955e1cc6. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:44 devstack sudo[92736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:44 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:44 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.362s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:44 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-35a56aa5-09ee-4472-846b-1e26de088cc4 tempest-GroupSnapshotsV319Test-1561643480 None] Delete group completed successfully. Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "cinder-371b5ba7-3864-42d2-96af-75cc2a66d9bb-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-371b5ba7-3864-42d2-96af-75cc2a66d9bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=112,cinder:INSERT=30,cinder:UPDATE=100,cinder:DELETE=6 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=110,cinder:UPDATE=111,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "cinder-quobyte-371b5ba7-3864-42d2-96af-75cc2a66d9bb" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-quobyte-371b5ba7-3864-42d2-96af-75cc2a66d9bb" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9678e09-7fb6-4950-ae86-b1b9cb1d3d4a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:50 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb Sep 01 01:41:50 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:50 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb" returned: 0 in 0.503s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:50 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb Sep 01 01:41:50 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:51 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-371b5ba7-3864-42d2-96af-75cc2a66d9bb" returned: 0 in 0.348s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-quobyte-371b5ba7-3864-42d2-96af-75cc2a66d9bb" released by "delete_volume" :: held 0.910s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Created reservations ['78083064-fd70-44c4-9f75-091351ed7765', 'aeeb9262-4c6b-42a0-b275-f0d133cf0b52', '8b81a91a-8023-4db4-9bb3-40312c9bede7', 'c5f16ab9-8421-4a96-8e54-03bb75fd5d83'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:51 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:51 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "cinder-6eabd475-2360-41c5-9f7e-e61d651de83f-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-6eabd475-2360-41c5-9f7e-e61d651de83f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "cinder-quobyte-6eabd475-2360-41c5-9f7e-e61d651de83f" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-quobyte-6eabd475-2360-41c5-9f7e-e61d651de83f" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[08063754-627b-490e-b0c4-3207ecfd84cb]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:51 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.377s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:51 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Deleted volume successfully. Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6e5c3ade-c396-4ff4-b1a7-74103b88c99b tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-371b5ba7-3864-42d2-96af-75cc2a66d9bb-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:51 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f Sep 01 01:41:51 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:51 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f" returned: 0 in 0.464s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:52 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f Sep 01 01:41:52 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:52 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6eabd475-2360-41c5-9f7e-e61d651de83f" returned: 0 in 0.363s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-quobyte-6eabd475-2360-41c5-9f7e-e61d651de83f" released by "delete_volume" :: held 0.899s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Created reservations ['9ea51807-1db3-4519-bb20-709dc43fd89d', 'dddac3a7-d094-421a-b554-4de78206ec02', 'b2e50d5b-79fd-44d3-b3c4-960056e478da', '593bc6f0-5051-44b1-ab1e-002c86d1d7d7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:52 devstack sudo[92787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:52 devstack sudo[92787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "cinder-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "cinder-quobyte-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-quobyte-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9ec4b4-a3f1-462a-aa07-b0770f9315ae]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:53 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc Sep 01 01:41:53 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:53 devstack sudo[92787]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.532s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Deleted volume successfully. Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27f41fac-76a6-47d1-9d4a-e6adc35bdfa5 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-6eabd475-2360-41c5-9f7e-e61d651de83f-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:53 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc" returned: 0 in 0.556s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:53 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc Sep 01 01:41:53 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:53 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc" returned: 0 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-quobyte-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc" released by "delete_volume" :: held 0.944s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:53 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Created reservations ['52597e11-2fed-4fe4-9a05-f51d9be882ae', 'ac2600af-1014-4baa-ba12-5b6554ee37c9', '4580f3f6-2a59-450c-b204-5dfd17fed429', '999f424c-5fb8-4cef-9d48-d0d7357207f6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-875a42e6-b00b-4a55-9787-e47385980630 tempest-GroupsV320Test-450488052 None] Group tempest-GroupsV320Test-Group-472771453: creating Sep 01 01:41:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-875a42e6-b00b-4a55-9787-e47385980630 tempest-GroupsV320Test-450488052 None] Group tempest-GroupsV320Test-Group-472771453: created successfully Sep 01 01:41:54 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-875a42e6-b00b-4a55-9787-e47385980630 tempest-GroupsV320Test-450488052 None] Create group completed successfully. Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:54 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:54 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:54 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.308s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:54 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Deleted volume successfully. Sep 01 01:41:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-861b4994-0b07-4c13-a198-b80a4f62f283 tempest-AttachVolumeTestJSON-216990028 None] Lock "cinder-dc49c9e9-71e6-4e1b-872e-c8891e5a36fc-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Created reservations ['406f8246-1aa0-4c85-acba-b46985ec000e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:55 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:41:55 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Flow 'volume_create_manager' (09672f90-2342-4b20-a028-0912aa1f62cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:41:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b522fe9-5822-4a30-9ae1-b2016b93aeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b522fe9-5822-4a30-9ae1-b2016b93aeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-226973758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d03d1b-0cdd-4858-a75a-9da0a2209191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc07c28504b4de997c6eae36d8fe0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:56Z,use_quota=True,user_id='cf034a6fac83449e85f00165f4611374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8087981e-ed51-48f7-bcdf-62b040db1991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8087981e-ed51-48f7-bcdf-62b040db1991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b34ef3-2fc0-48b8-92bb-12b6b5f1247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:41:56 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.371s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:41:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-05d5af37-844b-4ea7-9cd5-ca6c99b758c3 tempest-GroupsV320Test-450488052 None] Delete group completed successfully. Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b34ef3-2fc0-48b8-92bb-12b6b5f1247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8d03d1b-0cdd-4858-a75a-9da0a2209191', 'volume_name': 'volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a169ce8-9208-456a-b596-6a8d99b6c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a169ce8-9208-456a-b596-6a8d99b6c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c116e01-2def-4910-bd0c-1cd07d880d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:41:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Volume b8d03d1b-0cdd-4858-a75a-9da0a2209191: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Trying to clone b8d03d1b-0cdd-4858-a75a-9da0a2209191 from image babec01a-b62a-4774-aa41-a35db0f34a47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:41:56 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c937eb-f6b4-4355-9226-30432cfbc373]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:56 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD Sep 01 01:41:56 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:57 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 is fetched for user cf034a6fac83449e85f00165f4611374. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[080eaadc-987b-4a55-af98-97b2412cba8d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:57 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD Sep 01 01:41:57 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:57 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-226973758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d03d1b-0cdd-4858-a75a-9da0a2209191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc07c28504b4de997c6eae36d8fe0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:41:56Z,use_quota=True,user_id='cf034a6fac83449e85f00165f4611374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Creating volume b8d03d1b-0cdd-4858-a75a-9da0a2209191 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:41:57 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:41:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:57 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 1073741824 Sep 01 01:41:57 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:58 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 1073741824" returned: 0 in 0.482s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:58 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 Sep 01 01:41:58 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:58 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Attempting download of babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume b8d03d1b-0cdd-4858-a75a-9da0a2209191. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d721e6db-0fda-40ec-828d-f669976ff1ae]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_9wz7zsbl {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:58 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_9wz7zsbl Sep 01 01:41:58 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:59 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_9wz7zsbl" returned: 0 in 0.379s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_9wz7zsbl {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:59 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_9wz7zsbl Sep 01 01:41:59 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:59 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_9wz7zsbl" returned: 1 in 0.381s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_9wz7zsbl' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb36d8f-7550-4a98-95a4-30b0982d3818]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:59 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD Sep 01 01:41:59 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:41:59 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] babec01a-b62a-4774-aa41-a35db0f34a47 was qcow2, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:41:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:41:59 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 Sep 01 01:41:59 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:01 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191" returned: 0 in 2.131s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:01 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_j5sn_lzndevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:42:01 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Converted 112.00 MB image at 52.49 MB/s Sep 01 01:42:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:01 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 1G Sep 01 01:42:01 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:02 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 1G" returned: 0 in 0.470s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Downloaded image babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume b8d03d1b-0cdd-4858-a75a-9da0a2209191 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 for user cf034a6fac83449e85f00165f4611374 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Marking volume b8d03d1b-0cdd-4858-a75a-9da0a2209191 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Copying metadata from image babec01a-b62a-4774-aa41-a35db0f34a47 to b8d03d1b-0cdd-4858-a75a-9da0a2209191. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Creating volume glance metadata for volume b8d03d1b-0cdd-4858-a75a-9da0a2209191 backed by image babec01a-b62a-4774-aa41-a35db0f34a47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c116e01-2def-4910-bd0c-1cd07d880d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378228b8-98da-485c-97cb-4991079f49ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:02 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Volume volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 (b8d03d1b-0cdd-4858-a75a-9da0a2209191): created successfully Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378228b8-98da-485c-97cb-4991079f49ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Flow 'volume_create_manager' (09672f90-2342-4b20-a028-0912aa1f62cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:02 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d37ad8d9-1dc0-437e-a07a-7d0e6a25ab44 tempest-VolumesImageMetadata-155951885 None] Created volume successfully. Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Flow 'volume_create_manager' (40b38cce-c5b9-42e5-b68d-f55e9d1ecf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea4c08d-4e26-463a-9bf4-ab3a50b62df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea4c08d-4e26-463a-9bf4-ab3a50b62df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-145490432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672018a9-da45-4531-953a-46176e4d294b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416a5378395a452590753361ceb6b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:03Z,use_quota=True,user_id='7413221011824402a6c16635bcc8b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a1f13a-b695-44e3-a2ae-ef02e4f315c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a1f13a-b695-44e3-a2ae-ef02e4f315c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf602a4-d22c-4a38-80ff-385d0882a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf602a4-d22c-4a38-80ff-385d0882a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '672018a9-da45-4531-953a-46176e4d294b', 'volume_name': 'volume-672018a9-da45-4531-953a-46176e4d294b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770e8485-13a9-4bc8-b58d-f409c862a403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770e8485-13a9-4bc8-b58d-f409c862a403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4431701b-fd97-49db-ab86-f255a3db24a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:03 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Volume 672018a9-da45-4531-953a-46176e4d294b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-672018a9-da45-4531-953a-46176e4d294b', 'volume_size': 1} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-145490432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=672018a9-da45-4531-953a-46176e4d294b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416a5378395a452590753361ceb6b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:03Z,use_quota=True,user_id='7413221011824402a6c16635bcc8b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Creating volume 672018a9-da45-4531-953a-46176e4d294b {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:03 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:03 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b 1073741824 Sep 01 01:42:03 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:03 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b 1073741824" returned: 0 in 0.461s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:03 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b Sep 01 01:42:03 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Acquiring lock "cinder-b8d03d1b-0cdd-4858-a75a-9da0a2209191-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Lock "cinder-b8d03d1b-0cdd-4858-a75a-9da0a2209191-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Acquiring lock "cinder-quobyte-b8d03d1b-0cdd-4858-a75a-9da0a2209191" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Lock "cinder-quobyte-b8d03d1b-0cdd-4858-a75a-9da0a2209191" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8f052-0ad9-4b04-b2b3-8b9fcf30172d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:04 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 Sep 01 01:42:04 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:04 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b" returned: 0 in 0.296s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4431701b-fd97-49db-ab86-f255a3db24a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-672018a9-da45-4531-953a-46176e4d294b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fbebad-ef92-4067-88f9-a336faeac3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Volume volume-672018a9-da45-4531-953a-46176e4d294b (672018a9-da45-4531-953a-46176e4d294b): created successfully Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fbebad-ef92-4067-88f9-a336faeac3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Flow 'volume_create_manager' (40b38cce-c5b9-42e5-b68d-f55e9d1ecf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f4332983-1571-4216-bae8-5d5d93e60f0e tempest-VolumesTestJSON-1299098062 None] Created volume successfully. Sep 01 01:42:04 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191" returned: 0 in 0.358s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:04 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191 Sep 01 01:42:04 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:04 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b8d03d1b-0cdd-4858-a75a-9da0a2209191" returned: 0 in 0.243s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Lock "cinder-quobyte-b8d03d1b-0cdd-4858-a75a-9da0a2209191" released by "delete_volume" :: held 0.653s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Created reservations ['72efa310-f9ef-4003-8349-ddfcc277c83d', 'cd8d5663-3371-4dbd-a45f-209481a786ae', '9b7a1606-04dc-4bc3-911c-27b06b006138', 'e7c501b9-f75d-4430-b61d-5849c4a74e15'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:04 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:04 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:05 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.281s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:05 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Deleted volume successfully. Sep 01 01:42:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ab5d3249-b94f-4be0-880f-fe35d2b6202b tempest-VolumesImageMetadata-155951885 None] Lock "cinder-b8d03d1b-0cdd-4858-a75a-9da0a2209191-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Flow 'volume_create_manager' (0ffcd31d-3e60-46e6-94f5-244528ff5265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421326b6-600b-4b2f-b66d-c45de68b0433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421326b6-600b-4b2f-b66d-c45de68b0433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-50666168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416a5378395a452590753361ceb6b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:06Z,use_quota=True,user_id='7413221011824402a6c16635bcc8b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d123d82-df93-4e1b-86a4-047e67ae9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d123d82-df93-4e1b-86a4-047e67ae9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194f1dfc-565e-4da2-85ee-5a4ec7f16fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194f1dfc-565e-4da2-85ee-5a4ec7f16fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3', 'volume_name': 'volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38524108-d6f9-472a-8eae-fcd4b4b2d3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38524108-d6f9-472a-8eae-fcd4b4b2d3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959828f5-8c11-4a33-94b5-43113493d4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:06 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Volume e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3', 'volume_size': 1} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-50666168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416a5378395a452590753361ceb6b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:06Z,use_quota=True,user_id='7413221011824402a6c16635bcc8b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Creating volume e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:06 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:06 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 1073741824 Sep 01 01:42:06 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:07 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 1073741824" returned: 0 in 0.596s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:07 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 Sep 01 01:42:07 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:07 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959828f5-8c11-4a33-94b5-43113493d4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9646fa99-b953-45ab-a750-c43c54145dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:07 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Volume volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 (e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3): created successfully Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9646fa99-b953-45ab-a750-c43c54145dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Flow 'volume_create_manager' (0ffcd31d-3e60-46e6-94f5-244528ff5265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-631ac036-2c47-44e1-9fd2-db6a8fcee4ce tempest-VolumesTestJSON-1299098062 None] Created volume successfully. Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-13cdde50-9e8a-4e4c-96b2-1b34fd943910 req-f4a3fc27-1921-482d-a329-08cd99b32193 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-13cdde50-9e8a-4e4c-96b2-1b34fd943910 req-f4a3fc27-1921-482d-a329-08cd99b32193 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-13cdde50-9e8a-4e4c-96b2-1b34fd943910 req-f4a3fc27-1921-482d-a329-08cd99b32193 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-13cdde50-9e8a-4e4c-96b2-1b34fd943910 req-f4a3fc27-1921-482d-a329-08cd99b32193 tempest-ServerActionsTestOtherA-2144573553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39ea3dea-3094-4a2a-81e3-fb7c07eaa6b3', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:42:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-13cdde50-9e8a-4e4c-96b2-1b34fd943910 req-f4a3fc27-1921-482d-a329-08cd99b32193 tempest-ServerActionsTestOtherA-2144573553 None] attachment_update completed successfully. Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Flow 'volume_create_manager' (7c6ca702-5d9a-4511-813c-572b19f5e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2737ef-d941-4201-b2b6-699a927dd262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2737ef-d941-4201-b2b6-699a927dd262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1918729495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa760068-2348-4f0c-9d44-ab4c24344ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e4de374925491db880bff6fa53d51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:09Z,use_quota=True,user_id='4aea1e358b594796b679c273ef448229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a34b5b0-b1fc-427d-a587-45c15c948110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a34b5b0-b1fc-427d-a587-45c15c948110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17bd2f2-4d7c-4c7d-8661-909d124f19cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17bd2f2-4d7c-4c7d-8661-909d124f19cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa760068-2348-4f0c-9d44-ab4c24344ce7', 'volume_name': 'volume-fa760068-2348-4f0c-9d44-ab4c24344ce7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a909c75-0842-4650-9cf3-ab33f1a303d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a909c75-0842-4650-9cf3-ab33f1a303d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d115e53a-6438-4ee2-96e5-a8566127080c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Volume fa760068-2348-4f0c-9d44-ab4c24344ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa760068-2348-4f0c-9d44-ab4c24344ce7', 'volume_size': 1} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1918729495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa760068-2348-4f0c-9d44-ab4c24344ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e4de374925491db880bff6fa53d51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:09Z,use_quota=True,user_id='4aea1e358b594796b679c273ef448229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Creating volume fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:09 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:09 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 1073741824 Sep 01 01:42:09 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Flow 'volume_create_manager' (4ef4c7de-cdfc-4b00-af6d-9b745412bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86549971-eac9-4b2e-9b83-588c43423bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86549971-eac9-4b2e-9b83-588c43423bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1748087795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61014d1-5810-4ae8-8a72-92571200c0f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416a5378395a452590753361ceb6b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:10Z,use_quota=True,user_id='7413221011824402a6c16635bcc8b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52efac3d-718f-4b5a-b99d-426d82a3136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52efac3d-718f-4b5a-b99d-426d82a3136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ebb585-96a5-4890-a754-cfea95df3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ebb585-96a5-4890-a754-cfea95df3da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61014d1-5810-4ae8-8a72-92571200c0f3', 'volume_name': 'volume-d61014d1-5810-4ae8-8a72-92571200c0f3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20f4552-b564-4142-be0d-f2d6c068c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20f4552-b564-4142-be0d-f2d6c068c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0320d7d2-a419-458b-9883-acaaddefc7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:09 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Volume d61014d1-5810-4ae8-8a72-92571200c0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61014d1-5810-4ae8-8a72-92571200c0f3', 'volume_size': 1} Sep 01 01:42:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:10 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 1073741824" returned: 0 in 0.473s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:10 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 Sep 01 01:42:10 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Flow 'volume_create_manager' (c042885d-38f3-42e5-9ac6-91ac0b740ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65230ea-0617-4b7c-8dea-0d6b5d75efce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:10 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65230ea-0617-4b7c-8dea-0d6b5d75efce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2097890249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0923c83b-1b87-44d0-aeaa-8580a7056809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6755f03e16f244879dade5f6513df762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:10Z,use_quota=True,user_id='f78b669ba15a46fc82d15dcc47983139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250b77b3-de8a-46c2-aa01-aa1c33a74eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250b77b3-de8a-46c2-aa01-aa1c33a74eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65decfc-93b6-4e5e-bd5a-9b5d787c8a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65decfc-93b6-4e5e-bd5a-9b5d787c8a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0923c83b-1b87-44d0-aeaa-8580a7056809', 'volume_name': 'volume-0923c83b-1b87-44d0-aeaa-8580a7056809', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa49181-5291-4bee-80d2-88e90921f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa49181-5291-4bee-80d2-88e90921f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e0fead-c42a-4faa-ad3d-49f7bb2b1579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Volume 0923c83b-1b87-44d0-aeaa-8580a7056809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0923c83b-1b87-44d0-aeaa-8580a7056809', 'volume_size': 1} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7" returned: 0 in 0.364s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1748087795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61014d1-5810-4ae8-8a72-92571200c0f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='416a5378395a452590753361ceb6b85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:10Z,use_quota=True,user_id='7413221011824402a6c16635bcc8b0ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Creating volume d61014d1-5810-4ae8-8a72-92571200c0f3 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:10 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d115e53a-6438-4ee2-96e5-a8566127080c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa760068-2348-4f0c-9d44-ab4c24344ce7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b13a36-9f50-4aee-9999-be40f3863cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:10 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 1073741824 Sep 01 01:42:10 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Volume volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 (fa760068-2348-4f0c-9d44-ab4c24344ce7): created successfully Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b13a36-9f50-4aee-9999-be40f3863cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Flow 'volume_create_manager' (7c6ca702-5d9a-4511-813c-572b19f5e501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c35d836b-fe5e-49f0-8f07-c040319881ab tempest-VolumesDeleteCascade-891798718 None] Created volume successfully. Sep 01 01:42:11 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 1073741824" returned: 0 in 0.516s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:11 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 Sep 01 01:42:11 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:11 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3" returned: 0 in 0.297s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2097890249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0923c83b-1b87-44d0-aeaa-8580a7056809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6755f03e16f244879dade5f6513df762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:10Z,use_quota=True,user_id='f78b669ba15a46fc82d15dcc47983139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Creating volume 0923c83b-1b87-44d0-aeaa-8580a7056809 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:11 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0320d7d2-a419-458b-9883-acaaddefc7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61014d1-5810-4ae8-8a72-92571200c0f3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e158b0ae-d81c-4331-b8ab-4ee6de315caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:11 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 1073741824 Sep 01 01:42:11 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Volume volume-d61014d1-5810-4ae8-8a72-92571200c0f3 (d61014d1-5810-4ae8-8a72-92571200c0f3): created successfully Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e158b0ae-d81c-4331-b8ab-4ee6de315caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Flow 'volume_create_manager' (4ef4c7de-cdfc-4b00-af6d-9b745412bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cbe95bc5-8590-4358-9d1c-49667d7e386c tempest-VolumesTestJSON-1299098062 None] Created volume successfully. Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-7bf873cf-229a-4324-af6b-5ec57ca9891a req-58d10448-a2b0-4a71-b7c3-7b349c067939 tempest-ServerActionsTestOtherA-2144573553 None] Terminate volume connection completed successfully. Sep 01 01:42:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-7bf873cf-229a-4324-af6b-5ec57ca9891a req-58d10448-a2b0-4a71-b7c3-7b349c067939 tempest-ServerActionsTestOtherA-2144573553 None] Deleting attachment 39ea3dea-3094-4a2a-81e3-fb7c07eaa6b3. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:42:12 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 1073741824" returned: 0 in 0.604s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:12 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 Sep 01 01:42:12 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:12 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809" returned: 0 in 0.350s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.825s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e0fead-c42a-4faa-ad3d-49f7bb2b1579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0923c83b-1b87-44d0-aeaa-8580a7056809', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250f6e01-ce54-43d1-9ea5-dcf479bb3239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:12 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Volume volume-0923c83b-1b87-44d0-aeaa-8580a7056809 (0923c83b-1b87-44d0-aeaa-8580a7056809): created successfully Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250f6e01-ce54-43d1-9ea5-dcf479bb3239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Flow 'volume_create_manager' (c042885d-38f3-42e5-9ac6-91ac0b740ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Creating offline snapshot 9e877b30-9caf-4b15-ac88-13bfc8a8db77 of volume fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:42:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7ffb90a4-2526-4263-855e-248cdd9309c1 tempest-VolumeQuotasNegativeTestJSON-687873362 None] Created volume successfully. Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e65b49b-3d08-4018-b98d-845dc4af6a5c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-7bf873cf-229a-4324-af6b-5ec57ca9891a req-b02b661c-f42d-4d5d-9d69-d12418679a5f tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:12 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 Sep 01 01:42:12 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:12 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7" returned: 0 in 0.393s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:12 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 1G Sep 01 01:42:12 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:13 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 1G" returned: 0 in 0.407s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:13 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 Sep 01 01:42:13 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Acquiring lock "cinder-d61014d1-5810-4ae8-8a72-92571200c0f3-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-d61014d1-5810-4ae8-8a72-92571200c0f3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:13 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77" returned: 0 in 0.321s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:13 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 is being set with open permissions: ugo+rw Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:13 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 Sep 01 01:42:13 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Acquiring lock "cinder-quobyte-d61014d1-5810-4ae8-8a72-92571200c0f3" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-quobyte-d61014d1-5810-4ae8-8a72-92571200c0f3" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8178cb2c-6353-424a-9cf8-a04407b1abf7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:13 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 Sep 01 01:42:13 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:13 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77" returned: 0 in 0.253s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:13 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.info Sep 01 01:42:13 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:14 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3" returned: 0 in 0.413s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:14 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3 Sep 01 01:42:14 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:14 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.info" returned: 0 in 0.271s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:14 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.info is being set with open permissions: ugo+rw Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:14 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.info Sep 01 01:42:14 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:14 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d61014d1-5810-4ae8-8a72-92571200c0f3" returned: 0 in 0.265s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-quobyte-d61014d1-5810-4ae8-8a72-92571200c0f3" released by "delete_volume" :: held 0.722s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:14 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.info" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-7bf873cf-229a-4324-af6b-5ec57ca9891a req-b02b661c-f42d-4d5d-9d69-d12418679a5f tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.891s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Created reservations ['7bddb3c8-9f3a-4be7-a966-4499f36ad338', '6fe01f57-7f57-4ed3-b8b5-726c28b8914a', '1962b91e-3861-441c-bbe1-f50185a86d22', 'b38f84b1-ba26-4a7c-a1d2-eaf95c0d5df8'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9aa14e4b-b56e-4d89-ad3d-80013593a219 tempest-VolumesDeleteCascade-891798718 None] Create snapshot completed successfully Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-7bf873cf-229a-4324-af6b-5ec57ca9891a req-b02b661c-f42d-4d5d-9d69-d12418679a5f tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.104s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-7bf873cf-229a-4324-af6b-5ec57ca9891a req-b02b661c-f42d-4d5d-9d69-d12418679a5f tempest-ServerActionsTestOtherA-2144573553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aff06460-8da5-4f72-ba24-7c875727f57a', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:14 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:14 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-7bf873cf-229a-4324-af6b-5ec57ca9891a req-b02b661c-f42d-4d5d-9d69-d12418679a5f tempest-ServerActionsTestOtherA-2144573553 None] attachment_update completed successfully. Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Acquiring lock "cinder-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Lock "cinder-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Acquiring lock "cinder-0923c83b-1b87-44d0-aeaa-8580a7056809-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Acquiring lock "cinder-quobyte-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "cinder-0923c83b-1b87-44d0-aeaa-8580a7056809-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:15 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.356s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Lock "cinder-quobyte-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3" acquired by "delete_volume" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Deleted volume successfully. Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f7ae63-66ce-41e8-a40d-fa58a3afa728]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38fb5a57-9b3a-43e3-8283-172b03de3af0 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-d61014d1-5810-4ae8-8a72-92571200c0f3-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Acquiring lock "cinder-quobyte-0923c83b-1b87-44d0-aeaa-8580a7056809" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "cinder-quobyte-0923c83b-1b87-44d0-aeaa-8580a7056809" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3414ed-c5ab-4e20-8f96-8a65d39a0401]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:15 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 Sep 01 01:42:15 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:15 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 Sep 01 01:42:15 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Creating offline snapshot fbb6a682-cdbb-4118-992f-6ce3dbe3778b of volume fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1cd406-0d59-4b9a-afcd-7c82773f8575]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:15 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3" returned: 0 in 0.446s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:15 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3 Sep 01 01:42:15 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:15 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 Sep 01 01:42:15 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:15 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809" returned: 0 in 0.468s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:15 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809 Sep 01 01:42:15 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:15 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3" returned: 0 in 0.314s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:15 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Lock "cinder-quobyte-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3" released by "delete_volume" :: held 0.829s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77" returned: 0 in 0.415s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa760068-2348-4f0c-9d44-ab4c24344ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:15 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b 1G Sep 01 01:42:15 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Created reservations ['cd1e20ed-f756-4a37-a921-237c033d5922', '85f73764-621e-43a4-ab92-1e426703a762', 'e99b0cec-e771-44c7-bb66-98dd52387df8', 'd9809730-f5d5-4a53-ae24-35a3141c9b6c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:15 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0923c83b-1b87-44d0-aeaa-8580a7056809" returned: 0 in 0.308s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "cinder-quobyte-0923c83b-1b87-44d0-aeaa-8580a7056809" released by "delete_volume" :: held 0.842s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Created reservations ['1ae6f77f-0a6c-47ab-9107-454c026cf762', '1ef20806-206c-4886-8e1b-31cbc6a61baf', 'de63dd77-aa3c-49dd-8871-a207a0fb31ee', '9d2b9d19-2f60-4cd0-acc0-6e0c6bd3e184'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:16 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:16 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:16 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:16 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Acquiring lock "cinder-672018a9-da45-4531-953a-46176e4d294b-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-672018a9-da45-4531-953a-46176e4d294b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Acquiring lock "cinder-quobyte-672018a9-da45-4531-953a-46176e4d294b" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:16 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-quobyte-672018a9-da45-4531-953a-46176e4d294b" acquired by "delete_volume" :: waited 0.046s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.398s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee86b2-9fc0-47fd-a11c-b029fd4f8761]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:16 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.495s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Deleted volume successfully. Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-073d7bf8-8887-4e10-ba52-8c7737fb702e tempest-VolumeQuotasNegativeTestJSON-687873362 None] Lock "cinder-0923c83b-1b87-44d0-aeaa-8580a7056809-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Deleted volume successfully. Sep 01 01:42:16 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b 1G" returned: 0 in 0.904s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a05e5bd4-3379-432c-85fa-ae1542a7c08f tempest-VolumesTestJSON-1299098062 None] Lock "cinder-e3c639c5-5fcb-4f1a-b4d4-a444b123b4a3-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:16 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b Sep 01 01:42:16 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:16 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b Sep 01 01:42:16 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:17 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:17 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:17 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b" returned: 0 in 0.737s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:17 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b Sep 01 01:42:17 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:17 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b" returned: 0 in 0.656s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:17 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b is being set with open permissions: ugo+rw Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:17 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b Sep 01 01:42:17 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:17 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.578s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:42:17 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-672018a9-da45-4531-953a-46176e4d294b" returned: 0 in 0.589s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:17 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b" returned: 0 in 0.485s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-quobyte-672018a9-da45-4531-953a-46176e4d294b" released by "delete_volume" :: held 1.419s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4a9020b9-7d15-4ab0-af0b-3579e814667c tempest-VolumesDeleteCascade-891798718 None] Create snapshot completed successfully Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Created reservations ['33ce92fd-7609-49b4-b80c-8eddd5d7bdbe', '5a0c0938-c189-4a94-8e7a-5d3851bdaa72', 'ab753f79-456b-430c-87a7-6872a9571d9b', 'c43ace16-67f3-453c-a19d-2400378f3653'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:18 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:18 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:18 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.283s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Deleted volume successfully. Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5f7f141-3eef-43e7-b9cc-bed1285c41a6 tempest-VolumesTestJSON-1299098062 None] Lock "cinder-672018a9-da45-4531-953a-46176e4d294b-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-fa760068-2348-4f0c-9d44-ab4c24344ce7-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-fa760068-2348-4f0c-9d44-ab4c24344ce7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Performing cascade delete. {{(pid=87212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-9e877b30-9caf-4b15-ac88-13bfc8a8db77-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-9e877b30-9caf-4b15-ac88-13bfc8a8db77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-9e877b30-9caf-4b15-ac88-13bfc8a8db77" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-9e877b30-9caf-4b15-ac88-13bfc8a8db77" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Deleting offline snapshot 9e877b30-9caf-4b15-ac88-13bfc8a8db77 of volume fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] snapshot_file for this snap is: volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c12c3-c3bb-4806-9450-d1440fbccccf]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:19 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 Sep 01 01:42:19 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:20 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77" returned: 0 in 0.718s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa760068-2348-4f0c-9d44-ab4c24344ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:20 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8d2261-e9da-4ffa-939e-4321783aac19]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:20 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 Sep 01 01:42:20 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:20 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7" returned: 0 in 0.580s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:20 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dfba2e-7ea8-4bc8-b3d8-c2c42b5a328e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:20 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b Sep 01 01:42:20 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:21 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b" returned: 0 in 0.479s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa760068-2348-4f0c-9d44-ab4c24344ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b19e6-ed41-4c8f-8a8d-a3374c14e423]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:21 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 Sep 01 01:42:21 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:21 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77" returned: 0 in 0.635s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa760068-2348-4f0c-9d44-ab4c24344ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[232413ac-dd84-49a9-8345-b5e29227f894]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:22 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 Sep 01 01:42:22 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:22 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7" returned: 0 in 0.528s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:22 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 Sep 01 01:42:22 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:22 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77" returned: 0 in 0.390s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:22 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77 Sep 01 01:42:22 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:23 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.9e877b30-9caf-4b15-ac88-13bfc8a8db77" returned: 0 in 0.281s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b -F qcow2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:23 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b -F qcow2 Sep 01 01:42:23 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:23 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b -F qcow2" returned: 0 in 0.374s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-9e877b30-9caf-4b15-ac88-13bfc8a8db77" released by "_delete_snapshot" :: held 4.330s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" released by "delete_snapshot" :: held 4.377s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Created reservations ['93379464-fc1d-41f9-bed1-49f1ce851eaa', '7f2c54f3-b191-44ad-a389-d04bbd426991', '39ccdd50-d6e0-4491-bb5e-1fb6d56629ec', '98543a74-54df-4f11-a404-e6adb86bdcbe'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Delete snapshot completed successfully. Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-9e877b30-9caf-4b15-ac88-13bfc8a8db77-delete_snapshot" released by "delete_snapshot" :: held 4.659s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-fbb6a682-cdbb-4118-992f-6ce3dbe3778b-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-fbb6a682-cdbb-4118-992f-6ce3dbe3778b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-fbb6a682-cdbb-4118-992f-6ce3dbe3778b" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fbb6a682-cdbb-4118-992f-6ce3dbe3778b" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Deleting offline snapshot fbb6a682-cdbb-4118-992f-6ce3dbe3778b of volume fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:42:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] snapshot_file for this snap is: volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:42:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0986bd-1f0c-4d94-b42d-523aa7d55a5d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:24 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b Sep 01 01:42:24 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:24 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b" returned: 0 in 0.664s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa760068-2348-4f0c-9d44-ab4c24344ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f0949-a54a-4cf2-8d56-a4f1f31531c9]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:24 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 Sep 01 01:42:24 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:25 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7" returned: 0 in 0.688s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:25 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b Sep 01 01:42:25 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3232a918-8d17-4fcd-b1a6-76c235904e4f tempest-GroupSnapshotsTest-313661701 None] Group tempest-GroupSnapshotsTest-Group-1098840504: creating Sep 01 01:42:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3232a918-8d17-4fcd-b1a6-76c235904e4f tempest-GroupSnapshotsTest-313661701 None] Group tempest-GroupSnapshotsTest-Group-1098840504: created successfully Sep 01 01:42:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3232a918-8d17-4fcd-b1a6-76c235904e4f tempest-GroupSnapshotsTest-313661701 None] Create group completed successfully. Sep 01 01:42:25 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b" returned: 0 in 0.491s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:25 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b Sep 01 01:42:25 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:26 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7.fbb6a682-cdbb-4118-992f-6ce3dbe3778b" returned: 0 in 0.234s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fbb6a682-cdbb-4118-992f-6ce3dbe3778b" released by "_delete_snapshot" :: held 2.241s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" released by "delete_snapshot" :: held 2.290s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Created reservations ['6d3da2ed-4d0b-471b-9043-077a5b448940', '74f7e451-2127-4f82-abc1-44a3206dca6f', 'd4bb2e29-d898-4f48-9ef2-69f20821f9a9', 'bf3211b7-9f36-449d-968d-7b0d29d63d54'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:26 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Delete snapshot completed successfully. Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-fbb6a682-cdbb-4118-992f-6ce3dbe3778b-delete_snapshot" released by "delete_snapshot" :: held 2.635s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Snapshots deleted, issuing volume delete {{(pid=87212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[61919392-f7e4-49b1-9260-8d417d919b96]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:26 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 Sep 01 01:42:26 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:27 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7" returned: 0 in 0.478s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:27 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7 Sep 01 01:42:27 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:27 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fa760068-2348-4f0c-9d44-ab4c24344ce7" returned: 0 in 0.354s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-fa760068-2348-4f0c-9d44-ab4c24344ce7" released by "delete_volume" :: held 0.913s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Created reservations ['c66c0077-818a-4360-af99-933308524f6d', 'f6188d45-25f2-4b8e-b8d6-64c0814c3044', '970d88b4-99c0-4e81-bc69-3283fc8a075c', 'bd850dcb-424d-4117-bada-c3704348d087'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:27 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:27 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:27 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.384s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:28 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Deleted volume successfully. Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (d79bbd22-a3b6-4e4f-b2d5-6c92a68aab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8b3c89-4314-4368-9309-b36d2a289b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9ef8641b-604e-4458-bf7e-e200c81c8b48 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-fa760068-2348-4f0c-9d44-ab4c24344ce7-delete_volume" released by "delete_volume" :: held 9.078s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8b3c89-4314-4368-9309-b36d2a289b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53239188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2bd0149-0eb9-4457-9351-d9f481036fd6,host='devstack@QuobyteHD#QuobyteHD',id=9352c97d-9d55-4025-bfe2-8aa5eb0000de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:28Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56670e64-477f-47f7-b0f0-8f53e97c5f85),volume_type_id=56670e64-477f-47f7-b0f0-8f53e97c5f85)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bf54da-7723-4304-8c15-29cdcf879944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bf54da-7723-4304-8c15-29cdcf879944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee4e913-cff2-4ba6-b002-9bcec6ee0a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee4e913-cff2-4ba6-b002-9bcec6ee0a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9352c97d-9d55-4025-bfe2-8aa5eb0000de', 'volume_name': 'volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e41b49-eea7-44af-a6a9-5f0e0b5f7de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e41b49-eea7-44af-a6a9-5f0e0b5f7de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c88643-4b49-4fe9-9b8d-ec8e89767f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Volume 9352c97d-9d55-4025-bfe2-8aa5eb0000de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de', 'volume_size': 1} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f2bd0149-0eb9-4457-9351-d9f481036fd6,created_at=2026-08-31T23:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53239188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f2bd0149-0eb9-4457-9351-d9f481036fd6,host='devstack@QuobyteHD#QuobyteHD',id=9352c97d-9d55-4025-bfe2-8aa5eb0000de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:28Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56670e64-477f-47f7-b0f0-8f53e97c5f85),volume_type_id=56670e64-477f-47f7-b0f0-8f53e97c5f85)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Creating volume 9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:28 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:28 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de 1073741824 Sep 01 01:42:28 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:28 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de 1073741824" returned: 0 in 0.631s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:28 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de Sep 01 01:42:28 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:29 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Flow 'volume_create_manager' (0261ed4b-5e16-4993-86b9-1122a982d83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5e1b2a-4376-42f0-af2f-65ce35a7a1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de" returned: 0 in 0.422s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5e1b2a-4376-42f0-af2f-65ce35a7a1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-734896049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c1c99-bcea-4f23-a18c-107284a4929e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e4de374925491db880bff6fa53d51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:29Z,use_quota=True,user_id='4aea1e358b594796b679c273ef448229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641764d2-d409-4730-b2f6-b89e226f857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641764d2-d409-4730-b2f6-b89e226f857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5410598-65d3-4b57-ad69-1bd3879764c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5410598-65d3-4b57-ad69-1bd3879764c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77c1c99-bcea-4f23-a18c-107284a4929e', 'volume_name': 'volume-d77c1c99-bcea-4f23-a18c-107284a4929e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c61cb5-ffc9-4aea-9f82-6e904bbefeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c61cb5-ffc9-4aea-9f82-6e904bbefeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7424a5-0907-4ddb-9cff-9fb2c1d10543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Volume d77c1c99-bcea-4f23-a18c-107284a4929e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77c1c99-bcea-4f23-a18c-107284a4929e', 'volume_size': 1} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-734896049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77c1c99-bcea-4f23-a18c-107284a4929e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e4de374925491db880bff6fa53d51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:29Z,use_quota=True,user_id='4aea1e358b594796b679c273ef448229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Creating volume d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:29 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c88643-4b49-4fe9-9b8d-ec8e89767f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5701251-d674-43b0-a3e4-52853fb69d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:29 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e 1073741824 Sep 01 01:42:29 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Volume volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de (9352c97d-9d55-4025-bfe2-8aa5eb0000de): created successfully Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5701251-d674-43b0-a3e4-52853fb69d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (d79bbd22-a3b6-4e4f-b2d5-6c92a68aab64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fe96d714-7de2-459a-b76b-70d968b45f6c tempest-GroupSnapshotsTest-313661701 None] Created volume successfully. Sep 01 01:42:29 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e 1073741824" returned: 0 in 0.446s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:29 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e Sep 01 01:42:29 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:30 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e" returned: 0 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7424a5-0907-4ddb-9cff-9fb2c1d10543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77c1c99-bcea-4f23-a18c-107284a4929e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b19c4a7-00e7-49c9-acaf-35161a03486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Volume volume-d77c1c99-bcea-4f23-a18c-107284a4929e (d77c1c99-bcea-4f23-a18c-107284a4929e): created successfully Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b19c4a7-00e7-49c9-acaf-35161a03486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Flow 'volume_create_manager' (0261ed4b-5e16-4993-86b9-1122a982d83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f61fe942-4d69-4d05-9d14-88039e9c71a9 tempest-VolumesDeleteCascade-891798718 None] Created volume successfully. Sep 01 01:42:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] GroupSnapshot 3f8513f5-68b8-4fa3-bda0-c9da10b9f750: creating. Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Group snapshot 3f8513f5-68b8-4fa3-bda0-c9da10b9f750: creating. {{(pid=87212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Creating offline snapshot a16e1c43-e98e-4b2b-92b6-f575f9e147c2 of volume 9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d543d56-3ab0-428f-b8df-cfa3d5a05871]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:30 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de Sep 01 01:42:30 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:31 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de" returned: 0 in 0.410s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:31 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 1G Sep 01 01:42:31 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:31 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 1G" returned: 0 in 0.583s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:31 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 Sep 01 01:42:31 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:32 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2" returned: 0 in 0.316s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:32 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:32 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 Sep 01 01:42:32 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:32 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2" returned: 0 in 0.246s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:32 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.info Sep 01 01:42:32 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:32 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.info" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:32 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:32 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.info Sep 01 01:42:32 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:32 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.info" returned: 0 in 0.275s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.360s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Creating offline snapshot f40678bf-41a2-46b5-86f2-f592fe542100 of volume d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b416cc4-2f6c-4c3f-a578-3e8ea55a06dd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fab84282-e54f-4890-b974-51c744bb0c2b tempest-GroupSnapshotsTest-313661701 None] group_snapshot 3f8513f5-68b8-4fa3-bda0-c9da10b9f750: created successfully Sep 01 01:42:33 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e Sep 01 01:42:33 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:33 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e" returned: 0 in 0.402s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:33 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 1G Sep 01 01:42:33 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:33 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 1G" returned: 0 in 0.431s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d77c1c99-bcea-4f23-a18c-107284a4929e -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:33 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d77c1c99-bcea-4f23-a18c-107284a4929e -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 Sep 01 01:42:33 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:34 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d77c1c99-bcea-4f23-a18c-107284a4929e -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100" returned: 0 in 0.331s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:34 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 is being set with open permissions: ugo+rw Sep 01 01:42:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:34 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 Sep 01 01:42:34 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:34 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:34 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.info Sep 01 01:42:34 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:34 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.info" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:34 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.info is being set with open permissions: ugo+rw Sep 01 01:42:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:34 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.info Sep 01 01:42:34 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:35 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.info" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.516s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-a16e1c43-e98e-4b2b-92b6-f575f9e147c2-e88c4852-1dc1-487c-8705-f6f83cf933a6" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-a16e1c43-e98e-4b2b-92b6-f575f9e147c2-e88c4852-1dc1-487c-8705-f6f83cf933a6" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Creating volume e88c4852-1dc1-487c-8705-f6f83cf933a6 from snapshot a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-e88c4852-1dc1-487c-8705-f6f83cf933a6" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b6d70d87-a03f-4082-b92b-39397ef09b7c tempest-VolumesDeleteCascade-891798718 None] Create snapshot completed successfully Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-e88c4852-1dc1-487c-8705-f6f83cf933a6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] snapshot: a16e1c43-e98e-4b2b-92b6-f575f9e147c2, volume: e88c4852-1dc1-487c-8705-f6f83cf933a6, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2075ffe-2324-4c11-974f-ac8a33b5ee55]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:35 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 Sep 01 01:42:35 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:35 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2" returned: 0 in 0.376s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d4b45-8200-4f56-8662-bf4c7730c6a8]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:35 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de Sep 01 01:42:35 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Flow 'volume_create_manager' (cafa1670-32e3-4983-a0f4-691363f1e7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb387f60-952b-48dc-b8f8-21bcb700a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb387f60-952b-48dc-b8f8-21bcb700a93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1945799091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f647ff35-7dd0-428a-b412-2fe43b71855b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45fa6b377464c3492012ac0cc04fb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:36Z,use_quota=True,user_id='04ce4d349fb8440290173a9dc29cd0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb74bb99-d119-4969-b8f8-a7b12bb06ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb74bb99-d119-4969-b8f8-a7b12bb06ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a62017-1660-4c85-b99f-47b956387fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a62017-1660-4c85-b99f-47b956387fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f647ff35-7dd0-428a-b412-2fe43b71855b', 'volume_name': 'volume-f647ff35-7dd0-428a-b412-2fe43b71855b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518233bb-8fd5-42a2-a28c-aef5e791eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518233bb-8fd5-42a2-a28c-aef5e791eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc377f43-b811-4e70-8925-28fa7e8fa38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:35 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Volume f647ff35-7dd0-428a-b412-2fe43b71855b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f647ff35-7dd0-428a-b412-2fe43b71855b', 'volume_size': 1} Sep 01 01:42:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:36 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de" returned: 0 in 0.439s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:36 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 Sep 01 01:42:36 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Flow 'volume_create_manager' (a9121839-b069-42f4-a07b-55fbcdf1784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ea91a4-570d-4344-a226-c35871d9960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ea91a4-570d-4344-a226-c35871d9960e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1604559601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fdb82d-01c2-41b3-926b-63e111158864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e4de374925491db880bff6fa53d51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f40678bf-41a2-46b5-86f2-f592fe542100,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:36Z,use_quota=True,user_id='4aea1e358b594796b679c273ef448229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fffc45c-a4d1-4b6d-bbb6-5aeb58033c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fffc45c-a4d1-4b6d-bbb6-5aeb58033c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2890ab7-9b2b-4b3f-a032-d9ec8d3bfcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2890ab7-9b2b-4b3f-a032-d9ec8d3bfcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54fdb82d-01c2-41b3-926b-63e111158864', 'volume_name': 'volume-54fdb82d-01c2-41b3-926b-63e111158864', 'volume_size': 1, 'snapshot_id': 'f40678bf-41a2-46b5-86f2-f592fe542100'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47327b9f-ab29-4b65-b330-aeff50362ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47327b9f-ab29-4b65-b330-aeff50362ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a3dbc4-6835-446c-ab51-4c56d3e52334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Volume 54fdb82d-01c2-41b3-926b-63e111158864: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54fdb82d-01c2-41b3-926b-63e111158864', 'volume_size': 1, 'snapshot_id': 'f40678bf-41a2-46b5-86f2-f592fe542100'} Sep 01 01:42:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:41 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6" returned: 0 in 5.176s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:42:41 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Converted 1024.00 MB image at 197.78 MB/s Sep 01 01:42:41 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:41 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 Sep 01 01:42:41 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:41 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6" returned: 0 in 0.267s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-e88c4852-1dc1-487c-8705-f6f83cf933a6" released by "_copy_volume_from_snapshot" :: held 6.352s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-a16e1c43-e98e-4b2b-92b6-f575f9e147c2-e88c4852-1dc1-487c-8705-f6f83cf933a6" released by "_create_volume_from_snapshot" :: held 6.439s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.471s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.658s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1945799091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f647ff35-7dd0-428a-b412-2fe43b71855b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b45fa6b377464c3492012ac0cc04fb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:36Z,use_quota=True,user_id='04ce4d349fb8440290173a9dc29cd0b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Creating volume f647ff35-7dd0-428a-b412-2fe43b71855b {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:41 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:41 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b 1073741824 Sep 01 01:42:41 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cc9edd5d-fbde-4184-9487-13e2931614f1 tempest-GroupSnapshotsTest-313661701 None] Create group from source-snapshot-3f8513f5-68b8-4fa3-bda0-c9da10b9f750 completed successfully. Sep 01 01:42:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-bfbb2d8d-3631-488a-a4fe-1777c86d2b9f req-00fd3879-07e2-47c4-b9a7-481db93a52bf tempest-ServerActionsTestOtherA-2144573553 None] Terminate volume connection completed successfully. Sep 01 01:42:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-bfbb2d8d-3631-488a-a4fe-1777c86d2b9f req-00fd3879-07e2-47c4-b9a7-481db93a52bf tempest-ServerActionsTestOtherA-2144573553 None] Deleting attachment aff06460-8da5-4f72-ba24-7c875727f57a. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:42:42 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b 1073741824" returned: 0 in 0.468s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:42 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b Sep 01 01:42:42 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:42 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b" returned: 0 in 0.232s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.831s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-f40678bf-41a2-46b5-86f2-f592fe542100-54fdb82d-01c2-41b3-926b-63e111158864" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc377f43-b811-4e70-8925-28fa7e8fa38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f647ff35-7dd0-428a-b412-2fe43b71855b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4438002-7c8b-450f-afed-f3414e0f08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-f40678bf-41a2-46b5-86f2-f592fe542100-54fdb82d-01c2-41b3-926b-63e111158864" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Creating volume 54fdb82d-01c2-41b3-926b-63e111158864 from snapshot f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-54fdb82d-01c2-41b3-926b-63e111158864" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:42 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Volume volume-f647ff35-7dd0-428a-b412-2fe43b71855b (f647ff35-7dd0-428a-b412-2fe43b71855b): created successfully Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4438002-7c8b-450f-afed-f3414e0f08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Flow 'volume_create_manager' (cafa1670-32e3-4983-a0f4-691363f1e7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-54fdb82d-01c2-41b3-926b-63e111158864" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] snapshot: f40678bf-41a2-46b5-86f2-f592fe542100, volume: 54fdb82d-01c2-41b3-926b-63e111158864, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:42:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a3d3028d-a308-42c6-bca4-822c9653860c tempest-AbsoluteLimitsTests-1467616243 None] Created volume successfully. Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c30e3c-5589-4a96-95c6-ab38f64eeb7a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:42 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 Sep 01 01:42:42 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Acquiring lock "cinder-f647ff35-7dd0-428a-b412-2fe43b71855b-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Lock "cinder-f647ff35-7dd0-428a-b412-2fe43b71855b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Acquiring lock "cinder-quobyte-f647ff35-7dd0-428a-b412-2fe43b71855b" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100" returned: 0 in 0.506s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d77c1c99-bcea-4f23-a18c-107284a4929e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:42 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Lock "cinder-quobyte-f647ff35-7dd0-428a-b412-2fe43b71855b" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43de034-a2a2-4822-bdb8-849c0af16bdb]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0272fa3e-48a7-401f-92b0-dba8ba6e708e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:43 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e Sep 01 01:42:43 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:43 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b Sep 01 01:42:43 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-e88c4852-1dc1-487c-8705-f6f83cf933a6" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-e88c4852-1dc1-487c-8705-f6f83cf933a6" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb535f4-e203-4790-9001-db822f98dd26]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:43 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b" returned: 0 in 0.698s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:43 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e" returned: 0 in 0.733s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:42:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:43 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b Sep 01 01:42:43 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:43 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 Sep 01 01:42:43 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:43 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 Sep 01 01:42:43 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:44 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f647ff35-7dd0-428a-b412-2fe43b71855b" returned: 0 in 0.404s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:44 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6" returned: 0 in 0.507s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Lock "cinder-quobyte-f647ff35-7dd0-428a-b412-2fe43b71855b" released by "delete_volume" :: held 1.173s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:44 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6 Sep 01 01:42:44 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Created reservations ['8e9e82cf-ed7e-41a2-b435-73df331151a0', 'e3198d24-43f0-4709-a2e2-eb7cbb8a8b50', 'bc26b0a8-b372-444b-bfaa-f40636a55fe3', 'd064d17e-ce37-456f-9aae-a52d71701fe6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:44 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:44 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:44 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e88c4852-1dc1-487c-8705-f6f83cf933a6" returned: 0 in 0.507s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-e88c4852-1dc1-487c-8705-f6f83cf933a6" released by "delete_volume" :: held 1.110s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:44 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['1f4c41c0-64da-447a-90db-095d6d403bd2'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:44 devstack cinder-volume[87212]: WARNING cinder.quota [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2033027435 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2033027435, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:42:44 devstack cinder-volume[87212]: WARNING cinder.quota [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2033027435 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2033027435, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:42:44 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.701s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Deleted volume successfully. Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['3dc2fca0-15db-4d1f-850a-16310106b73b', '4fef2527-177b-49ae-b7ee-96ac9474f705', 'b3d87451-554c-4ff6-80fa-019532249b26', 'def549eb-6c41-4c23-8c67-b6b6bb4e7cd8'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4d2f3c5e-b193-44b3-8109-5d09f618a0ff tempest-AbsoluteLimitsTests-1467616243 None] Lock "cinder-f647ff35-7dd0-428a-b412-2fe43b71855b-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:45 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:45 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:45 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] group_snapshot 3f8513f5-68b8-4fa3-bda0-c9da10b9f750: deleting Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.455s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] group_snapshot 3f8513f5-68b8-4fa3-bda0-c9da10b9f750: deleting {{(pid=87212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:42:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4263b122-4d96-42c7-a61a-f07bb842dae6 tempest-GroupSnapshotsTest-313661701 None] Delete group completed successfully. Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-9352c97d-9d55-4025-bfe2-8aa5eb0000de" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-9352c97d-9d55-4025-bfe2-8aa5eb0000de" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-a16e1c43-e98e-4b2b-92b6-f575f9e147c2" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-a16e1c43-e98e-4b2b-92b6-f575f9e147c2" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Deleting offline snapshot a16e1c43-e98e-4b2b-92b6-f575f9e147c2 of volume 9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:42:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] snapshot_file for this snap is: volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:42:46 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfe1f47-9f60-4f43-848b-3e7f232481c6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:46 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 Sep 01 01:42:46 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:47 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2" returned: 0 in 1.119s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:47 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab8a3d-7c4e-48b6-abd4-dba5565d071b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:47 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de Sep 01 01:42:47 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:48 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de" returned: 0 in 0.834s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:48 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 Sep 01 01:42:48 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:48 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2" returned: 0 in 0.907s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:49 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2 Sep 01 01:42:49 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:49 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de.a16e1c43-e98e-4b2b-92b6-f575f9e147c2" returned: 0 in 0.793s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-a16e1c43-e98e-4b2b-92b6-f575f9e147c2" released by "_delete_snapshot" :: held 4.003s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-9352c97d-9d55-4025-bfe2-8aa5eb0000de" released by "delete_snapshot" :: held 4.078s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:50 devstack cinder-volume[87212]: WARNING cinder.quota [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2033027435 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2033027435, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['a3cef494-80c6-4737-9ad9-9dab1d661d12', '09121026-b3d5-4b57-a3ac-b5fe7d60ae56', 'c2bd3fa4-41ff-49f9-b240-7832d5f18f90', 'bf78b613-13eb-47c7-ba30-36526c6ac4d7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=147,cinder:INSERT=34,cinder:UPDATE=147,cinder:DELETE=12 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=147,cinder:INSERT=50,cinder:UPDATE=151,cinder:DELETE=10 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:42:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a33308d7-5efd-403e-8d2d-3e6b1f694756 tempest-GroupSnapshotsTest-313661701 None] group_snapshot 3f8513f5-68b8-4fa3-bda0-c9da10b9f750: deleted successfully Sep 01 01:42:50 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864" returned: 0 in 6.592s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:42:50 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Converted 1024.00 MB image at 155.33 MB/s Sep 01 01:42:50 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 is being set with open permissions: ugo+rw Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:50 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 Sep 01 01:42:50 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:50 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-54fdb82d-01c2-41b3-926b-63e111158864" released by "_copy_volume_from_snapshot" :: held 8.233s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-f40678bf-41a2-46b5-86f2-f592fe542100-54fdb82d-01c2-41b3-926b-63e111158864" released by "_create_volume_from_snapshot" :: held 8.317s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.351s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a3dbc4-6835-446c-ab51-4c56d3e52334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fdb82d-01c2-41b3-926b-63e111158864', 'volume_size': 1, 'snapshot_id': 'f40678bf-41a2-46b5-86f2-f592fe542100'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e83642-9ca2-49cb-8954-3ba926986cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:50 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Volume volume-54fdb82d-01c2-41b3-926b-63e111158864 (54fdb82d-01c2-41b3-926b-63e111158864): created successfully Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e83642-9ca2-49cb-8954-3ba926986cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Flow 'volume_create_manager' (a9121839-b069-42f4-a07b-55fbcdf1784a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-56139ef5-b523-4981-a034-63a469990415 tempest-VolumesDeleteCascade-891798718 None] Created volume successfully. Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-9352c97d-9d55-4025-bfe2-8aa5eb0000de" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-9352c97d-9d55-4025-bfe2-8aa5eb0000de" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c00fc8-a546-4abe-8c47-b23f7f001c59]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:51 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de Sep 01 01:42:51 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-d77c1c99-bcea-4f23-a18c-107284a4929e-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:51 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de" returned: 0 in 0.460s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-d77c1c99-bcea-4f23-a18c-107284a4929e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:51 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de Sep 01 01:42:51 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Performing cascade delete. {{(pid=87212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-f40678bf-41a2-46b5-86f2-f592fe542100-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-f40678bf-41a2-46b5-86f2-f592fe542100-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-d77c1c99-bcea-4f23-a18c-107284a4929e" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Flow 'volume_create_manager' (38768609-d10c-4147-bacb-fcd7df22db54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb93196-8940-4b95-9f38-2b0a511a2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-d77c1c99-bcea-4f23-a18c-107284a4929e" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-f40678bf-41a2-46b5-86f2-f592fe542100" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb93196-8940-4b95-9f38-2b0a511a2b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1765738020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2280cc9-1796-4286-bd32-e5ac3efba993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbb5147abf724724a5f92df7f3973c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:52Z,use_quota=True,user_id='18f244b7436e4313b90d1a930f3473fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d80623c-1898-4230-87be-b1dc13b15d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d80623c-1898-4230-87be-b1dc13b15d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22690e96-0b5f-4537-9ccc-bbf7eaef84dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-f40678bf-41a2-46b5-86f2-f592fe542100" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Deleting offline snapshot f40678bf-41a2-46b5-86f2-f592fe542100 of volume d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] snapshot_file for this snap is: volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:42:51 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9352c97d-9d55-4025-bfe2-8aa5eb0000de" returned: 0 in 0.310s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[87869ae9-2d3e-48bd-ab0d-eb1ab4072577]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-9352c97d-9d55-4025-bfe2-8aa5eb0000de" released by "delete_volume" :: held 0.857s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Created reservations ['26e6f12f-fb5d-4a26-b908-b5d08dd0738c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:52 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 Sep 01 01:42:52 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:52 devstack cinder-volume[87212]: WARNING cinder.db.api [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2033027435'] Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Created reservations ['dd27aa34-5963-4405-8609-b50e6b302ba2', '2fd18f1c-abbe-464c-8ab7-f9eb11e20b52', '10dafa37-423a-4833-b8b8-7b5e9372b05e', '1905fe03-2d6c-4a49-bd5a-236b4aff6faf'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:52 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:52 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22690e96-0b5f-4537-9ccc-bbf7eaef84dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2280cc9-1796-4286-bd32-e5ac3efba993', 'volume_name': 'volume-c2280cc9-1796-4286-bd32-e5ac3efba993', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb50e54b-c4c2-4823-8b90-9d8638b8cce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb50e54b-c4c2-4823-8b90-9d8638b8cce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:52 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4fd9b0-f4c5-40a8-82d3-9519eb6c7bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Volume c2280cc9-1796-4286-bd32-e5ac3efba993: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2280cc9-1796-4286-bd32-e5ac3efba993', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Trying to clone c2280cc9-1796-4286-bd32-e5ac3efba993 from image babec01a-b62a-4774-aa41-a35db0f34a47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100" returned: 0 in 0.561s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d77c1c99-bcea-4f23-a18c-107284a4929e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d5c49-dd74-492e-b632-1ea83aeae043]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:52 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.423s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:52 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:52 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0f4687cd-530d-4cd0-ae4b-697d5ee4610d tempest-GroupSnapshotsTest-313661701 None] Delete group completed successfully. Sep 01 01:42:52 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e Sep 01 01:42:52 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d992772e-a60d-40e4-82ca-fc66d4f90156 tempest-GroupSnapshotsTest-313661701 None] Group tempest-GroupSnapshotsTest-Group-1604061639: creating Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:42:53 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:42:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d992772e-a60d-40e4-82ca-fc66d4f90156 tempest-GroupSnapshotsTest-313661701 None] Group tempest-GroupSnapshotsTest-Group-1604061639: created successfully Sep 01 01:42:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d992772e-a60d-40e4-82ca-fc66d4f90156 tempest-GroupSnapshotsTest-313661701 None] Create group completed successfully. Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bcf076-3f55-49d7-987c-1d5e0e887407]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:53 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD Sep 01 01:42:53 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:53 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e" returned: 0 in 0.723s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:53 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 Sep 01 01:42:53 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:53 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 is fetched for user 18f244b7436e4313b90d1a930f3473fd. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b576aa0-0077-4d8f-a199-632f318c824f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:53 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100" returned: 0 in 0.387s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:53 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100 Sep 01 01:42:53 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:53 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD Sep 01 01:42:53 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:53 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e.f40678bf-41a2-46b5-86f2-f592fe542100" returned: 0 in 0.280s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:53 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1765738020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2280cc9-1796-4286-bd32-e5ac3efba993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbb5147abf724724a5f92df7f3973c1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:52Z,use_quota=True,user_id='18f244b7436e4313b90d1a930f3473fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Creating volume c2280cc9-1796-4286-bd32-e5ac3efba993 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:53 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-f40678bf-41a2-46b5-86f2-f592fe542100" released by "_delete_snapshot" :: held 2.111s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-d77c1c99-bcea-4f23-a18c-107284a4929e" released by "delete_snapshot" :: held 2.168s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:54 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 1073741824 Sep 01 01:42:54 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Created reservations ['3e26e33f-a295-4322-a17e-23d44efcdb27', '10749858-b169-4a68-84c3-311660f54fc2', 'b9cb0a74-58d0-43bf-ad9a-2c7f7188f42d', '68217d89-e091-4cdc-be7e-388db16e4070'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:54 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Delete snapshot completed successfully. Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-f40678bf-41a2-46b5-86f2-f592fe542100-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Snapshots deleted, issuing volume delete {{(pid=87212) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-d77c1c99-bcea-4f23-a18c-107284a4929e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-d77c1c99-bcea-4f23-a18c-107284a4929e" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad89e1dc-80de-4b9b-8447-aa6422f0092a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:54 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e Sep 01 01:42:54 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:54 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 1073741824" returned: 0 in 0.590s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:54 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 Sep 01 01:42:54 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:54 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (ddbddbfa-11e3-4b4b-b41d-b3b0a55345f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e28964-48f7-463d-b3b9-e7222211de3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e" returned: 0 in 0.593s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e28964-48f7-463d-b3b9-e7222211de3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1480402288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0e154f5-0d79-440b-8361-f8c2c787e24a,host='devstack@QuobyteHD#QuobyteHD',id=04c940ed-8f0d-4b25-accf-265da411ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:55Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40e2bf62-9653-400d-be2f-4fbe29fe2c59),volume_type_id=40e2bf62-9653-400d-be2f-4fbe29fe2c59)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c17865c-79b2-4c3f-9fa8-84dad630f760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c17865c-79b2-4c3f-9fa8-84dad630f760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:54 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e Sep 01 01:42:54 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16c317e-6a02-4d39-9e51-6fed9853b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16c317e-6a02-4d39-9e51-6fed9853b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c940ed-8f0d-4b25-accf-265da411ce9f', 'volume_name': 'volume-04c940ed-8f0d-4b25-accf-265da411ce9f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac30a512-26ba-4a73-9b9b-1b25789f1c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac30a512-26ba-4a73-9b9b-1b25789f1c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8091da39-dbe4-4904-b4e3-2c819945fa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:54 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Volume 04c940ed-8f0d-4b25-accf-265da411ce9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c940ed-8f0d-4b25-accf-265da411ce9f', 'volume_size': 1} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:54 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993" returned: 0 in 0.337s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0e154f5-0d79-440b-8361-f8c2c787e24a,created_at=2026-08-31T23:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1480402288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0e154f5-0d79-440b-8361-f8c2c787e24a,host='devstack@QuobyteHD#QuobyteHD',id=04c940ed-8f0d-4b25-accf-265da411ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:55Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40e2bf62-9653-400d-be2f-4fbe29fe2c59),volume_type_id=40e2bf62-9653-400d-be2f-4fbe29fe2c59)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Creating volume 04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:54 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:55 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f 1073741824 Sep 01 01:42:55 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Attempting download of babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume c2280cc9-1796-4286-bd32-e5ac3efba993. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[88147615-02de-45db-b643-acc3b67f1c5e]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_x4pzkzag {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:55 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d77c1c99-bcea-4f23-a18c-107284a4929e" returned: 0 in 0.334s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-d77c1c99-bcea-4f23-a18c-107284a4929e" released by "delete_volume" :: held 1.013s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:55 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_x4pzkzag Sep 01 01:42:55 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Created reservations ['b0cc1ea0-6283-4331-80c3-f54ed0e8da49', '79ed6866-cd1d-431f-a682-8d6c40bf2b20', '7d5d650b-f5e2-4410-9d54-5594f09be3bc', '5efac8f3-b0be-4dfd-915b-a938dd017a16'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:55 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:55 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:55 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_x4pzkzag" returned: 0 in 0.382s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_x4pzkzag {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:55 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f 1073741824" returned: 0 in 0.523s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:55 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f Sep 01 01:42:55 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:55 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_x4pzkzag Sep 01 01:42:55 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:55 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:55 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Deleted volume successfully. Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-84e2706f-ff05-46e8-bdad-92723535ea6d tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-d77c1c99-bcea-4f23-a18c-107284a4929e-delete_volume" released by "delete_volume" :: held 4.024s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:55 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8091da39-dbe4-4904-b4e3-2c819945fa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c940ed-8f0d-4b25-accf-265da411ce9f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:55 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ffc0c0-e4ea-41bc-ae39-bfce0b080b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_x4pzkzag" returned: 1 in 0.407s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_x4pzkzag' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d007887-36f9-4809-9311-630d09301d4e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:55 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Volume volume-04c940ed-8f0d-4b25-accf-265da411ce9f (04c940ed-8f0d-4b25-accf-265da411ce9f): created successfully Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ffc0c0-e4ea-41bc-ae39-bfce0b080b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (ddbddbfa-11e3-4b4b-b41d-b3b0a55345f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:55 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-810194f7-e802-4a8a-b0c5-d7d717526d45 tempest-GroupSnapshotsTest-313661701 None] Created volume successfully. Sep 01 01:42:56 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD Sep 01 01:42:56 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Flow 'volume_create_manager' (2252eed2-bc96-412d-8c47-e5aae289bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac4fba2-cdd1-4e64-93ca-8e293bc7592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac4fba2-cdd1-4e64-93ca-8e293bc7592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1487641465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1739d8e-92ac-446c-96d6-a9835aed7168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c522daf02b344993a7af781d8c2026b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:56Z,use_quota=True,user_id='65451b4801274abfabb403bf37c096df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a34f0db-ff19-4e72-8a39-fcb6a014c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a34f0db-ff19-4e72-8a39-fcb6a014c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5996f187-e333-4bce-a57e-e2d878aed7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5996f187-e333-4bce-a57e-e2d878aed7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1739d8e-92ac-446c-96d6-a9835aed7168', 'volume_name': 'volume-a1739d8e-92ac-446c-96d6-a9835aed7168', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75a16d2-8500-4bac-83be-dff0d9f57526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75a16d2-8500-4bac-83be-dff0d9f57526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ece6831-f092-45aa-8e6e-dfced45516a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Volume a1739d8e-92ac-446c-96d6-a9835aed7168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1739d8e-92ac-446c-96d6-a9835aed7168', 'volume_size': 1} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1487641465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1739d8e-92ac-446c-96d6-a9835aed7168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c522daf02b344993a7af781d8c2026b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:56Z,use_quota=True,user_id='65451b4801274abfabb403bf37c096df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Creating volume a1739d8e-92ac-446c-96d6-a9835aed7168 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:56 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:56 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 1073741824 Sep 01 01:42:56 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-54fdb82d-01c2-41b3-926b-63e111158864-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-54fdb82d-01c2-41b3-926b-63e111158864-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "cinder-quobyte-54fdb82d-01c2-41b3-926b-63e111158864" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:56 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] babec01a-b62a-4774-aa41-a35db0f34a47 was qcow2, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-54fdb82d-01c2-41b3-926b-63e111158864" acquired by "delete_volume" :: waited 0.040s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:56 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 Sep 01 01:42:56 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba842fe0-e57c-43de-955e-f1aa20377d06]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:56 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 Sep 01 01:42:56 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:56 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 1073741824" returned: 0 in 0.428s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:56 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 Sep 01 01:42:56 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:56 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864" returned: 0 in 0.400s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:56 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864 Sep 01 01:42:56 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:56 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168" returned: 0 in 0.261s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ece6831-f092-45aa-8e6e-dfced45516a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1739d8e-92ac-446c-96d6-a9835aed7168', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661501a8-6f31-4119-84e8-57a66be6907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Volume volume-a1739d8e-92ac-446c-96d6-a9835aed7168 (a1739d8e-92ac-446c-96d6-a9835aed7168): created successfully Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661501a8-6f31-4119-84e8-57a66be6907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Flow 'volume_create_manager' (2252eed2-bc96-412d-8c47-e5aae289bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f114f96b-db1f-4560-8368-adab64461142 tempest-VolumesTransfersV355Test-1342853940 None] Created volume successfully. Sep 01 01:42:57 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-54fdb82d-01c2-41b3-926b-63e111158864" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-quobyte-54fdb82d-01c2-41b3-926b-63e111158864" released by "delete_volume" :: held 0.738s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Created reservations ['96a53acb-1f1d-427f-8b08-c2c2a539ffd2', 'e200d2d1-9934-440b-9042-ef1212c01516', '268b18a5-e73b-459f-a9ae-2f441d1fe4c4', '126e3a37-86fb-4fe5-8b24-ec1b5242df4c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:57 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:57 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:57 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.270s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:42:57 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Deleted volume successfully. Sep 01 01:42:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2e7e9e87-a6ec-4423-90c0-9b5779e4ece7 tempest-VolumesDeleteCascade-891798718 None] Lock "cinder-54fdb82d-01c2-41b3-926b-63e111158864-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:57 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fc6841dd-8b5e-4bfc-b57c-88f2c70ac20b tempest-VolumesTransfersV355Test-612480463 None] Transfer volume completed successfully. Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (1dc666f4-15d2-47db-b085-aa9d82a12025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7858a9f4-dcff-4f02-b11c-e0d7ec3938a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7858a9f4-dcff-4f02-b11c-e0d7ec3938a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1339508704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0e154f5-0d79-440b-8361-f8c2c787e24a,host='devstack@QuobyteHD#QuobyteHD',id=fe89f0e5-f778-420c-ba98-2f8161c77c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:58Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40e2bf62-9653-400d-be2f-4fbe29fe2c59),volume_type_id=40e2bf62-9653-400d-be2f-4fbe29fe2c59)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98159e90-f44a-4cb4-9038-a7984f532f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98159e90-f44a-4cb4-9038-a7984f532f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20198e48-2059-40c8-89d2-b8e288e91206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20198e48-2059-40c8-89d2-b8e288e91206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe89f0e5-f778-420c-ba98-2f8161c77c48', 'volume_name': 'volume-fe89f0e5-f778-420c-ba98-2f8161c77c48', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04da430e-c0ea-4444-b67b-5f5e0b1e131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04da430e-c0ea-4444-b67b-5f5e0b1e131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834a7214-80da-45f2-8b02-7eab039a7bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:58 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Volume fe89f0e5-f778-420c-ba98-2f8161c77c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe89f0e5-f778-420c-ba98-2f8161c77c48', 'volume_size': 1} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0e154f5-0d79-440b-8361-f8c2c787e24a,created_at=2026-08-31T23:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1339508704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0e154f5-0d79-440b-8361-f8c2c787e24a,host='devstack@QuobyteHD#QuobyteHD',id=fe89f0e5-f778-420c-ba98-2f8161c77c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:42:58Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40e2bf62-9653-400d-be2f-4fbe29fe2c59),volume_type_id=40e2bf62-9653-400d-be2f-4fbe29fe2c59)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Creating volume fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:42:58 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:58 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 1073741824 Sep 01 01:42:58 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:58 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993" returned: 0 in 2.162s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_d3iz1s7adevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:42:58 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Converted 112.00 MB image at 51.74 MB/s Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:58 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 1G Sep 01 01:42:58 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Acquiring lock "cinder-a1739d8e-92ac-446c-96d6-a9835aed7168-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-a1739d8e-92ac-446c-96d6-a9835aed7168-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Acquiring lock "cinder-quobyte-a1739d8e-92ac-446c-96d6-a9835aed7168" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-quobyte-a1739d8e-92ac-446c-96d6-a9835aed7168" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb82369-6f80-464a-924e-ece0d60e807c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:58 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 1073741824" returned: 0 in 0.563s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:58 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 Sep 01 01:42:58 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:58 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 Sep 01 01:42:58 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:58 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 1G" returned: 0 in 0.449s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Downloaded image babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume c2280cc9-1796-4286-bd32-e5ac3efba993 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 for user 18f244b7436e4313b90d1a930f3473fd is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Marking volume c2280cc9-1796-4286-bd32-e5ac3efba993 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Copying metadata from image babec01a-b62a-4774-aa41-a35db0f34a47 to c2280cc9-1796-4286-bd32-e5ac3efba993. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:42:58 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Creating volume glance metadata for volume c2280cc9-1796-4286-bd32-e5ac3efba993 backed by image babec01a-b62a-4774-aa41-a35db0f34a47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4fd9b0-f4c5-40a8-82d3-9519eb6c7bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2280cc9-1796-4286-bd32-e5ac3efba993', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1446c1-cb66-47af-a9cb-503bf0a4e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:59 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48" returned: 0 in 0.376s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:59 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Volume volume-c2280cc9-1796-4286-bd32-e5ac3efba993 (c2280cc9-1796-4286-bd32-e5ac3efba993): created successfully Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e1446c1-cb66-47af-a9cb-503bf0a4e92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Flow 'volume_create_manager' (38768609-d10c-4147-bacb-fcd7df22db54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834a7214-80da-45f2-8b02-7eab039a7bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe89f0e5-f778-420c-ba98-2f8161c77c48', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4d621d-5732-4703-8f20-3d5e0493f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:42:59 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168" returned: 0 in 0.550s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:59 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1be60294-cc21-4bac-9fde-feb4bcda6bda tempest-ServerActionsTestOtherA-2144573553 None] Created volume successfully. Sep 01 01:42:59 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Volume volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 (fe89f0e5-f778-420c-ba98-2f8161c77c48): created successfully Sep 01 01:42:59 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168 Sep 01 01:42:59 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4d621d-5732-4703-8f20-3d5e0493f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (1dc666f4-15d2-47db-b085-aa9d82a12025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:42:59 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-83966110-0c2f-4f77-9e53-43348d569d5c tempest-GroupSnapshotsTest-313661701 None] Created volume successfully. Sep 01 01:42:59 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1739d8e-92ac-446c-96d6-a9835aed7168" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-quobyte-a1739d8e-92ac-446c-96d6-a9835aed7168" released by "delete_volume" :: held 0.898s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Created reservations ['af550ec8-f1c3-46d9-9cac-3a5aefa12d22', '7863beab-350f-499f-badc-f3361f7014da', '851f0c1a-f866-4a08-ba34-e738c17359a8', '780b51e8-cdfb-4771-8aac-274976ec54af'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:42:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:42:59 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:42:59 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:00 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.351s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:00 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Deleted volume successfully. Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d3c72272-d074-4124-9f63-06b67eb85c63 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-a1739d8e-92ac-446c-96d6-a9835aed7168-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Flow 'volume_create_manager' (ce563a7e-94b3-4f09-93b9-b233ac341ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb4cd5c-0715-4830-88bb-e7481ed66429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb4cd5c-0715-4830-88bb-e7481ed66429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-31895439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7615c45-8895-4953-8a4f-6ec9bfe26bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c522daf02b344993a7af781d8c2026b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:00Z,use_quota=True,user_id='65451b4801274abfabb403bf37c096df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6e50b1-98a8-4f28-81f6-ed25e281778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb6e50b1-98a8-4f28-81f6-ed25e281778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe19d31a-4456-442e-b86a-d0bc43563c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe19d31a-4456-442e-b86a-d0bc43563c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7615c45-8895-4953-8a4f-6ec9bfe26bf8', 'volume_name': 'volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557caace-3725-4b44-84bc-8ef5660f50e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557caace-3725-4b44-84bc-8ef5660f50e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7f4090-51a9-42bc-9158-20767807c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:00 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Volume b7615c45-8895-4953-8a4f-6ec9bfe26bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8', 'volume_size': 1} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-31895439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7615c45-8895-4953-8a4f-6ec9bfe26bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c522daf02b344993a7af781d8c2026b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:00Z,use_quota=True,user_id='65451b4801274abfabb403bf37c096df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Creating volume b7615c45-8895-4953-8a4f-6ec9bfe26bf8 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:00 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:00 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 1073741824 Sep 01 01:43:00 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:00 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0c521b7f-d6a2-454b-93cc-7894cc4c2416 tempest-GroupSnapshotsTest-313661701 None] Update group completed successfully. Sep 01 01:43:01 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 1073741824" returned: 0 in 0.508s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:01 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 Sep 01 01:43:01 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:01 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8" returned: 0 in 0.276s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7f4090-51a9-42bc-9158-20767807c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd4946e-aa67-4441-a83e-fac86872b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:01 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Volume volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 (b7615c45-8895-4953-8a4f-6ec9bfe26bf8): created successfully Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd4946e-aa67-4441-a83e-fac86872b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Flow 'volume_create_manager' (ce563a7e-94b3-4f09-93b9-b233ac341ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3d18d755-44a7-4845-9eae-8d7a9d5a8359 tempest-VolumesTransfersV355Test-1342853940 None] Created volume successfully. Sep 01 01:43:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-76f5158c-be64-49c3-a38a-cca5805fdd06 tempest-GroupSnapshotsTest-313661701 None] Update group completed successfully. Sep 01 01:43:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-9933a7d8-d03d-4cfc-a0ca-a72b501a6a1c req-b1c9bfbf-bc8b-4668-86f6-806f9b488193 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-9933a7d8-d03d-4cfc-a0ca-a72b501a6a1c req-b1c9bfbf-bc8b-4668-86f6-806f9b488193 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-9933a7d8-d03d-4cfc-a0ca-a72b501a6a1c req-b1c9bfbf-bc8b-4668-86f6-806f9b488193 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-9933a7d8-d03d-4cfc-a0ca-a72b501a6a1c req-b1c9bfbf-bc8b-4668-86f6-806f9b488193 tempest-ServerActionsTestOtherA-2144573553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-c2280cc9-1796-4286-bd32-e5ac3efba993', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5910e771-f545-4b42-bfd4-da54834c8c51', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:43:03 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-9933a7d8-d03d-4cfc-a0ca-a72b501a6a1c req-b1c9bfbf-bc8b-4668-86f6-806f9b488193 tempest-ServerActionsTestOtherA-2144573553 None] attachment_update completed successfully. Sep 01 01:43:03 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-24bf1451-0088-4752-9d29-89f29cd37b3a tempest-GroupSnapshotsTest-313661701 None] Update group completed successfully. Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Acquiring lock "cinder-b7615c45-8895-4953-8a4f-6ec9bfe26bf8-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-b7615c45-8895-4953-8a4f-6ec9bfe26bf8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Acquiring lock "cinder-quobyte-b7615c45-8895-4953-8a4f-6ec9bfe26bf8" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-quobyte-b7615c45-8895-4953-8a4f-6ec9bfe26bf8" acquired by "delete_volume" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591c7d9-136c-4190-bfc1-3237521b4684]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:03 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 Sep 01 01:43:03 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:03 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8" returned: 0 in 0.463s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:03 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8 Sep 01 01:43:03 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:04 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b7615c45-8895-4953-8a4f-6ec9bfe26bf8" returned: 0 in 0.302s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-quobyte-b7615c45-8895-4953-8a4f-6ec9bfe26bf8" released by "delete_volume" :: held 0.825s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Created reservations ['d9e887f3-e0cc-440e-b6a2-517d058af4db', '553d0134-fee3-4d72-a84c-e5acf1beb69c', '0a653c7b-a550-4d73-b417-0f08c2464a05', '0d4ef783-eb2b-472e-bc68-37b3d998f0b7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Flow 'volume_create_manager' (4de75ed3-25d2-419b-898d-84be0b968b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7356b391-62c8-4a4b-b1f1-277a9efc26a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7356b391-62c8-4a4b-b1f1-277a9efc26a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-869773307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86baea5-9420-443b-9996-0978d7430c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446d1c2a84444f0a929e993fba99ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:04Z,use_quota=True,user_id='327d8131ffd4473b88d35f65cc888580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd762c0b-40e1-4939-917a-f91794178fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd762c0b-40e1-4939-917a-f91794178fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1057ee4c-7dc9-4ed5-9468-be0e7f2b6a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1057ee4c-7dc9-4ed5-9468-be0e7f2b6a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e86baea5-9420-443b-9996-0978d7430c5b', 'volume_name': 'volume-e86baea5-9420-443b-9996-0978d7430c5b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb55f07d-829d-4954-9eae-64a9ac7b0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb55f07d-829d-4954-9eae-64a9ac7b0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97ba684-8a4f-4963-9995-8914cf19bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Volume e86baea5-9420-443b-9996-0978d7430c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e86baea5-9420-443b-9996-0978d7430c5b', 'volume_size': 1} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-869773307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86baea5-9420-443b-9996-0978d7430c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446d1c2a84444f0a929e993fba99ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:04Z,use_quota=True,user_id='327d8131ffd4473b88d35f65cc888580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Creating volume e86baea5-9420-443b-9996-0978d7430c5b {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:04 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:04 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b 1073741824 Sep 01 01:43:04 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-52ea1447-4e98-4062-bb66-8d145bb8bd62 tempest-GroupSnapshotsTest-313661701 None] Update group completed successfully. Sep 01 01:43:04 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:04 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:04 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.333s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:04 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Deleted volume successfully. Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-00116bf0-04e1-4be4-83aa-dd366c8a01b7 tempest-VolumesTransfersV355Test-1061335299 None] Lock "cinder-b7615c45-8895-4953-8a4f-6ec9bfe26bf8-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:05 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b 1073741824" returned: 0 in 0.602s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:05 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b Sep 01 01:43:05 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:05 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b" returned: 0 in 0.273s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97ba684-8a4f-4963-9995-8914cf19bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86baea5-9420-443b-9996-0978d7430c5b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90beb899-c139-45ef-9731-37ec3797eb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:05 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Volume volume-e86baea5-9420-443b-9996-0978d7430c5b (e86baea5-9420-443b-9996-0978d7430c5b): created successfully Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90beb899-c139-45ef-9731-37ec3797eb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Flow 'volume_create_manager' (4de75ed3-25d2-419b-898d-84be0b968b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-beedf093-4199-4ca5-863d-40ec4e0b9d99 tempest-VolumesTransfersTest-346787829 None] Created volume successfully. Sep 01 01:43:06 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] GroupSnapshot bec7be23-dd7b-40f9-b7f5-32bdfaf9ea1b: creating. Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Group snapshot bec7be23-dd7b-40f9-b7f5-32bdfaf9ea1b: creating. {{(pid=87212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Creating offline snapshot 4fce6b12-ad4e-41f7-93f9-476065af8ba8 of volume fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525f848-9e5e-4436-9acd-6d0a2742e6a9]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:06 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 Sep 01 01:43:06 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:06 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48" returned: 0 in 0.592s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:06 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 1G Sep 01 01:43:06 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:07 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 1G" returned: 0 in 0.857s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:07 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 Sep 01 01:43:07 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-10a050db-45e2-4495-a6da-6671cfbfb5db tempest-VolumesTransfersTest-1592119228 None] Transfer volume completed successfully. Sep 01 01:43:08 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8" returned: 0 in 0.592s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:08 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:43:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:08 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 Sep 01 01:43:08 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:08 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8" returned: 0 in 0.471s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:09 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.info Sep 01 01:43:09 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Acquiring lock "cinder-e86baea5-9420-443b-9996-0978d7430c5b-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Lock "cinder-e86baea5-9420-443b-9996-0978d7430c5b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Acquiring lock "cinder-quobyte-e86baea5-9420-443b-9996-0978d7430c5b" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Lock "cinder-quobyte-e86baea5-9420-443b-9996-0978d7430c5b" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f32098a-fb6d-4458-9a56-98c3ed136876]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:09 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.info" returned: 0 in 0.436s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:09 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:09 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.info Sep 01 01:43:09 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:09 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b Sep 01 01:43:09 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:09 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.info" returned: 0 in 0.366s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.692s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:09 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b" returned: 0 in 0.528s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Creating offline snapshot eb492bc6-9c98-48e2-b77f-4a30cf141709 of volume 04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:43:09 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b Sep 01 01:43:09 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e860b8a5-9ff0-465d-b71b-15707cbaf0b6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:10 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f Sep 01 01:43:10 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:10 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e86baea5-9420-443b-9996-0978d7430c5b" returned: 0 in 0.334s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Lock "cinder-quobyte-e86baea5-9420-443b-9996-0978d7430c5b" released by "delete_volume" :: held 0.941s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Created reservations ['dadd4a67-6dbc-4933-83a9-da8da3375169', 'db0d971b-6b37-4c7e-916d-52daed52703e', 'fdb61c66-b6e6-4182-8e3b-e932f465292b', '38adbd5f-c380-451d-b6e9-f3ae32af9ecc'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:10 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:10 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:10 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f" returned: 0 in 0.774s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:10 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 1G Sep 01 01:43:10 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:10 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.494s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:10 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Deleted volume successfully. Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6605a700-abe7-4ef7-aaad-ec216a84e6bf tempest-VolumesTransfersTest-352447739 None] Lock "cinder-e86baea5-9420-443b-9996-0978d7430c5b-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:11 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 1G" returned: 0 in 0.988s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c940ed-8f0d-4b25-accf-265da411ce9f -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:11 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c940ed-8f0d-4b25-accf-265da411ce9f -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 Sep 01 01:43:11 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Flow 'volume_create_manager' (056a74f7-0165-44e1-b329-b60052ed9277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383985c6-4609-4568-b89a-b1cd9badf4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383985c6-4609-4568-b89a-b1cd9badf4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2054468849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b308b90-a2c8-4f38-9633-29d50b58c182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446d1c2a84444f0a929e993fba99ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:12Z,use_quota=True,user_id='327d8131ffd4473b88d35f65cc888580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa56a91-d15d-4bd5-9611-e99e326b43c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa56a91-d15d-4bd5-9611-e99e326b43c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab538901-9408-49b8-8e15-a2c89de00728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab538901-9408-49b8-8e15-a2c89de00728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b308b90-a2c8-4f38-9633-29d50b58c182', 'volume_name': 'volume-5b308b90-a2c8-4f38-9633-29d50b58c182', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2a1d73-3141-4b2f-b92a-ccac86e179b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2a1d73-3141-4b2f-b92a-ccac86e179b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bd7541-f51d-4660-8301-d27f526be0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Volume 5b308b90-a2c8-4f38-9633-29d50b58c182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b308b90-a2c8-4f38-9633-29d50b58c182', 'volume_size': 1} Sep 01 01:43:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:12 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04c940ed-8f0d-4b25-accf-265da411ce9f -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709" returned: 0 in 0.573s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:12 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:43:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:12 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 Sep 01 01:43:12 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:12 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709" returned: 0 in 0.358s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:12 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.info Sep 01 01:43:12 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:13 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.info" returned: 0 in 0.404s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:13 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:13 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.info Sep 01 01:43:13 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:13 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.info" returned: 0 in 0.382s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.632s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2054468849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b308b90-a2c8-4f38-9633-29d50b58c182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446d1c2a84444f0a929e993fba99ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:12Z,use_quota=True,user_id='327d8131ffd4473b88d35f65cc888580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Creating volume 5b308b90-a2c8-4f38-9633-29d50b58c182 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:13 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:13 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 1073741824 Sep 01 01:43:13 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:13 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-92ee32fd-399f-4f1b-9a6f-6b44255f1368 tempest-GroupSnapshotsTest-313661701 None] group_snapshot bec7be23-dd7b-40f9-b7f5-32bdfaf9ea1b: created successfully Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Flow 'volume_create_manager' (fd12980f-0af4-4d9d-acd8-242f0c5c7b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1523623f-e7eb-44dd-baf0-47913c974f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1523623f-e7eb-44dd-baf0-47913c974f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-924784432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8859092f-509b-498e-bd9e-2b4e452871aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758b6ffd5d6f46eaa9a7043b9547f9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:14Z,use_quota=True,user_id='87aca17609144d3887a6a34981b6424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c949b4f-1240-4e8e-82b2-469dbf1597df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:14 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c949b4f-1240-4e8e-82b2-469dbf1597df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fb690c-61a4-4e71-bca9-0fa0f0bb49f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fb690c-61a4-4e71-bca9-0fa0f0bb49f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8859092f-509b-498e-bd9e-2b4e452871aa', 'volume_name': 'volume-8859092f-509b-498e-bd9e-2b4e452871aa', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cb1f1b-9a2b-44bf-b655-0331c12f6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cb1f1b-9a2b-44bf-b655-0331c12f6192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137ac1c9-9f58-4def-bf9e-ba361a1ff147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:14 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Volume 8859092f-509b-498e-bd9e-2b4e452871aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8859092f-509b-498e-bd9e-2b4e452871aa', 'volume_size': 1} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 1073741824" returned: 0 in 0.912s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:14 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 Sep 01 01:43:14 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:14 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182" returned: 0 in 0.287s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-924784432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8859092f-509b-498e-bd9e-2b4e452871aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758b6ffd5d6f46eaa9a7043b9547f9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:14Z,use_quota=True,user_id='87aca17609144d3887a6a34981b6424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Creating volume 8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:14 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bd7541-f51d-4660-8301-d27f526be0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b308b90-a2c8-4f38-9633-29d50b58c182', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:14 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa 1073741824 Sep 01 01:43:14 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08eed192-9bc0-4e66-b246-b4ca2dd59be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:14 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Volume volume-5b308b90-a2c8-4f38-9633-29d50b58c182 (5b308b90-a2c8-4f38-9633-29d50b58c182): created successfully Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08eed192-9bc0-4e66-b246-b4ca2dd59be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Flow 'volume_create_manager' (056a74f7-0165-44e1-b329-b60052ed9277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-656941b3-4801-4195-836d-7d1c54f0308b tempest-VolumesTransfersTest-346787829 None] Created volume successfully. Sep 01 01:43:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] group_snapshot bec7be23-dd7b-40f9-b7f5-32bdfaf9ea1b: deleting Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] group_snapshot bec7be23-dd7b-40f9-b7f5-32bdfaf9ea1b: deleting {{(pid=87212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-fe89f0e5-f778-420c-ba98-2f8161c77c48" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-fe89f0e5-f778-420c-ba98-2f8161c77c48" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-4fce6b12-ad4e-41f7-93f9-476065af8ba8" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-4fce6b12-ad4e-41f7-93f9-476065af8ba8" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Deleting offline snapshot 4fce6b12-ad4e-41f7-93f9-476065af8ba8 of volume fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] snapshot_file for this snap is: volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[012fb7f8-794a-4a67-8d4a-29288d5a29f4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:15 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 Sep 01 01:43:15 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:15 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa 1073741824" returned: 0 in 0.876s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:15 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa Sep 01 01:43:15 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:15 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8" returned: 0 in 0.785s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe89f0e5-f778-420c-ba98-2f8161c77c48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbdaf32-7881-4cd7-a16a-c1cde7066672]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:16 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa" returned: 0 in 0.528s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:16 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 Sep 01 01:43:16 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137ac1c9-9f58-4def-bf9e-ba361a1ff147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8859092f-509b-498e-bd9e-2b4e452871aa', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b486ece-daf0-4e46-8db9-912f7caa3674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Volume volume-8859092f-509b-498e-bd9e-2b4e452871aa (8859092f-509b-498e-bd9e-2b4e452871aa): created successfully Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b486ece-daf0-4e46-8db9-912f7caa3674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Flow 'volume_create_manager' (fd12980f-0af4-4d9d-acd8-242f0c5c7b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-155ce515-f469-4c30-9dd3-5d61c0226556 tempest-VolumesCloneTest-99467976 None] Created volume successfully. Sep 01 01:43:16 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Acquiring lock "cinder-5b308b90-a2c8-4f38-9633-29d50b58c182-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48" returned: 0 in 0.637s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:16 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 Sep 01 01:43:16 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Lock "cinder-5b308b90-a2c8-4f38-9633-29d50b58c182-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Acquiring lock "cinder-quobyte-5b308b90-a2c8-4f38-9633-29d50b58c182" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Lock "cinder-quobyte-5b308b90-a2c8-4f38-9633-29d50b58c182" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92998d7-668e-49e0-b143-50b0830a335b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:17 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 Sep 01 01:43:17 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:17 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:17 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:17 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8" returned: 0 in 0.489s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:17 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8 Sep 01 01:43:17 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:17 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182" returned: 0 in 0.566s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:17 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.462s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:17 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182 Sep 01 01:43:17 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:43:17 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48.4fce6b12-ad4e-41f7-93f9-476065af8ba8" returned: 0 in 0.491s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-4fce6b12-ad4e-41f7-93f9-476065af8ba8" released by "_delete_snapshot" :: held 2.603s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-fe89f0e5-f778-420c-ba98-2f8161c77c48" released by "delete_snapshot" :: held 2.650s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-04c940ed-8f0d-4b25-accf-265da411ce9f" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-04c940ed-8f0d-4b25-accf-265da411ce9f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-eb492bc6-9c98-48e2-b77f-4a30cf141709" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-eb492bc6-9c98-48e2-b77f-4a30cf141709" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Deleting offline snapshot eb492bc6-9c98-48e2-b77f-4a30cf141709 of volume 04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] snapshot_file for this snap is: volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2214f7ca-e7c2-41f8-8505-264e89896812]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:17 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5b308b90-a2c8-4f38-9633-29d50b58c182" returned: 0 in 0.473s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Lock "cinder-quobyte-5b308b90-a2c8-4f38-9633-29d50b58c182" released by "delete_volume" :: held 1.094s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Created reservations ['865773f4-a722-491b-b8fe-5cc16e64cd1f', '79db5c29-e0ee-4704-85f5-fa101b38b848', '7a15103d-7471-444d-8bb5-27dc465115b8', 'ea9edb51-bc56-4574-af05-827e4341ed6f'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:18 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 Sep 01 01:43:18 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:18 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:18 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:18 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.385s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Deleted volume successfully. Sep 01 01:43:18 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709" returned: 0 in 0.683s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04c940ed-8f0d-4b25-accf-265da411ce9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bee884e6-2473-4fea-b8f2-9d261362a443 tempest-VolumesTransfersTest-352447739 None] Lock "cinder-5b308b90-a2c8-4f38-9633-29d50b58c182-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c6efa4-4f6f-4ee4-b3da-e7d1696107cd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Flow 'volume_create_manager' (4ad8a636-825e-443a-938f-42ca66a22acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ab3446-2d0b-4231-aead-1670c683ea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:18 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f Sep 01 01:43:18 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ab3446-2d0b-4231-aead-1670c683ea1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-82294988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758b6ffd5d6f46eaa9a7043b9547f9af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8859092f-509b-498e-bd9e-2b4e452871aa,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:19Z,use_quota=True,user_id='87aca17609144d3887a6a34981b6424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268c725c-7872-45e1-a509-d1822389147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268c725c-7872-45e1-a509-d1822389147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9431f4f-922c-4985-8a8c-480f8e3d75be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9431f4f-922c-4985-8a8c-480f8e3d75be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb', 'volume_name': 'volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb', 'volume_size': 2, 'source_volid': '8859092f-509b-498e-bd9e-2b4e452871aa', 'source_volstatus': 'available'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490ba792-d18d-4aee-a246-517279f9566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490ba792-d18d-4aee-a246-517279f9566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebfaa3c-b594-4b5e-9928-93bc809d8ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:18 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Volume 0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb', 'volume_size': 2, 'source_volid': '8859092f-509b-498e-bd9e-2b4e452871aa', 'source_volstatus': 'available'} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:18 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Cloning volume 8859092f-509b-498e-bd9e-2b4e452871aa to volume 0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Creating offline snapshot f291ba92-e269-418f-ae7e-7eea147176b8 of volume 8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[def0fe49-dad0-46c0-8e02-bae039bff184]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:19 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa Sep 01 01:43:19 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:19 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f" returned: 0 in 0.563s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:19 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 Sep 01 01:43:19 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:19 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa" returned: 0 in 0.577s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:19 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 1G Sep 01 01:43:19 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:19 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709" returned: 0 in 0.439s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:19 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709 Sep 01 01:43:19 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:20 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f.eb492bc6-9c98-48e2-b77f-4a30cf141709" returned: 0 in 0.423s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-eb492bc6-9c98-48e2-b77f-4a30cf141709" released by "_delete_snapshot" :: held 2.277s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-04c940ed-8f0d-4b25-accf-265da411ce9f" released by "delete_snapshot" :: held 2.322s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:20 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-c5036ec5-cf99-4388-9d55-06a7d4d85e9f req-2d4bb092-48b6-42aa-a202-052322790bac tempest-ServerActionsTestOtherA-2144573553 None] Terminate volume connection completed successfully. Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-c5036ec5-cf99-4388-9d55-06a7d4d85e9f req-2d4bb092-48b6-42aa-a202-052322790bac tempest-ServerActionsTestOtherA-2144573553 None] Deleting attachment 5910e771-f545-4b42-bfd4-da54834c8c51. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:43:20 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 1G" returned: 0 in 0.784s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8859092f-509b-498e-bd9e-2b4e452871aa -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:20 devstack cinder-volume[87212]: WARNING cinder.quota [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-11943741 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-11943741, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:43:20 devstack cinder-volume[87212]: WARNING cinder.quota [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-11943741 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-11943741, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:43:20 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8859092f-509b-498e-bd9e-2b4e452871aa -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 Sep 01 01:43:20 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['f6f42444-791f-4afe-a35e-0e4babbf8339', '503e21ca-55bc-4cb8-b395-79a811a3cb4c', 'f05950cc-7ed3-46bb-81f1-8b8324dc9835', '008589f6-4ea6-4803-ada1-8f9376a29f26'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['bf75801f-95a5-4d7a-93df-99361f80a0f9', '86947252-8598-4571-8270-0c83b7bbeb09', '7ae185ff-6f6a-4960-9df4-25200853ef9e', '1f57ea7c-3f49-48a1-8829-de6803bd65b5'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:20 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-dc9f828a-04f9-4820-b089-8b97c5ea2b98 tempest-GroupSnapshotsTest-313661701 None] group_snapshot bec7be23-dd7b-40f9-b7f5-32bdfaf9ea1b: deleted successfully Sep 01 01:43:20 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8859092f-509b-498e-bd9e-2b4e452871aa -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8" returned: 0 in 0.496s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:20 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 is being set with open permissions: ugo+rw Sep 01 01:43:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:20 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 Sep 01 01:43:20 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:21 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8" returned: 0 in 0.331s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:21 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.info Sep 01 01:43:21 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:21 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.info" returned: 0 in 0.311s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:21 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.info is being set with open permissions: ugo+rw Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:21 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.info Sep 01 01:43:21 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-04c940ed-8f0d-4b25-accf-265da411ce9f" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-04c940ed-8f0d-4b25-accf-265da411ce9f" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13737a4-9e0f-41fc-8abd-9f17965bd3b4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:21 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.info" returned: 0 in 0.409s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:21 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f Sep 01 01:43:21 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Acquiring lock "cinder-quobyte-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] snapshot: f291ba92-e269-418f-ae7e-7eea147176b8, volume: 0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6efd07f-3f7f-4c07-b7b6-eb67cd80dbd8]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:22 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 Sep 01 01:43:22 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:22 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f" returned: 0 in 0.702s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:22 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f Sep 01 01:43:22 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:22 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8" returned: 0 in 0.600s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8859092f-509b-498e-bd9e-2b4e452871aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1464b825-4fde-43ec-8ec5-b55645d41480]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-c5036ec5-cf99-4388-9d55-06a7d4d85e9f req-75f2a802-031e-4713-b182-fd131fc249d2 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:22 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa Sep 01 01:43:22 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:22 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-04c940ed-8f0d-4b25-accf-265da411ce9f" returned: 0 in 0.369s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-04c940ed-8f0d-4b25-accf-265da411ce9f" released by "delete_volume" :: held 1.184s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-fe89f0e5-f778-420c-ba98-2f8161c77c48" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-fe89f0e5-f778-420c-ba98-2f8161c77c48" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a682d874-73ae-473e-8c27-d02c41adba3a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:23 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 Sep 01 01:43:23 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:23 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa" returned: 0 in 0.519s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:23 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb Sep 01 01:43:23 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:23 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48" returned: 0 in 0.420s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:23 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48 Sep 01 01:43:23 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:23 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-fe89f0e5-f778-420c-ba98-2f8161c77c48" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-fe89f0e5-f778-420c-ba98-2f8161c77c48" released by "delete_volume" :: held 0.800s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['3672e01a-8195-4622-9039-d2da3d64188e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:23 devstack cinder-volume[87212]: WARNING cinder.quota [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-11943741 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-11943741, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:43:23 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['145c3a44-275c-48d0-854f-cfd46b4b991b', 'a1e7cd42-a7e9-45c2-9ed8-3df1a7fdf06b', 'c4f81674-ec62-4f5d-8ec3-904170d32f9c', 'a60a8fc5-9a39-453b-a18d-0e6339166414'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:24 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Created reservations ['fda156b7-4c43-498d-9a94-35aca1b63660', 'b36d3f98-c529-4f2c-9cf2-2082ee5e6980', '6740b8a6-7018-4412-905c-667f83d92588', '34745aa3-7d46-4572-802b-2397ed6c252d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:24 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:24 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:25 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.539s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:25 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-824358c3-e392-4149-9b78-1338b8561982 tempest-GroupSnapshotsTest-313661701 None] Delete group completed successfully. Sep 01 01:43:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0098bd7e-4a3b-489e-b431-3dcd5ee62aa9 tempest-GroupSnapshotsTest-313661701 None] Group tempest-GroupSnapshotsTest-Group-1882615497: creating Sep 01 01:43:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0098bd7e-4a3b-489e-b431-3dcd5ee62aa9 tempest-GroupSnapshotsTest-313661701 None] Group tempest-GroupSnapshotsTest-Group-1882615497: created successfully Sep 01 01:43:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0098bd7e-4a3b-489e-b431-3dcd5ee62aa9 tempest-GroupSnapshotsTest-313661701 None] Create group completed successfully. Sep 01 01:43:28 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" returned: 0 in 5.636s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:28 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:43:28 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Converted 1024.00 MB image at 181.67 MB/s Sep 01 01:43:28 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb is being set with open permissions: ugo+rw Sep 01 01:43:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:28 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb Sep 01 01:43:28 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:29 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" returned: 0 in 0.275s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" released by "_copy_volume_from_snapshot" :: held 7.142s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Acquiring lock "cinder-quobyte-f291ba92-e269-418f-ae7e-7eea147176b8" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (3f47a9fa-c352-4241-b6a8-35db6ae4cb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db65d6b-2930-48b1-97f7-6dbb629c11f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-f291ba92-e269-418f-ae7e-7eea147176b8" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Deleting offline snapshot f291ba92-e269-418f-ae7e-7eea147176b8 of volume 8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] snapshot_file for this snap is: volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db65d6b-2930-48b1-97f7-6dbb629c11f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-401963409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44847d25-e788-41df-b551-6629fbb2215f,host='devstack@QuobyteHD#QuobyteHD',id=4d2c8ce3-af5f-43a9-9eac-bce340bfefa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:29Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dd092f3-56c1-4670-a8ce-f6c3f9e9870f),volume_type_id=5dd092f3-56c1-4670-a8ce-f6c3f9e9870f)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ebe02-55b5-4b8d-8ed3-57c7d3600a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ebe02-55b5-4b8d-8ed3-57c7d3600a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3ca491-7922-4e49-ba43-21063e77f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3ca491-7922-4e49-ba43-21063e77f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2c8ce3-af5f-43a9-9eac-bce340bfefa4', 'volume_name': 'volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4f3c4d-3be9-4e3b-bee0-f9d10c2033f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4f3c4d-3be9-4e3b-bee0-f9d10c2033f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ab7b5f-c5c4-4062-82c8-375b7f5d4e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Volume 4d2c8ce3-af5f-43a9-9eac-bce340bfefa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4', 'volume_size': 1} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc6005f-e34c-4f9c-a1b2-2d5b272e7003]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:29 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 Sep 01 01:43:29 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:29 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8" returned: 0 in 0.383s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8859092f-509b-498e-bd9e-2b4e452871aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ceeb1d-58a8-4020-aac1-cb15b1a7bbeb]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:29 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa Sep 01 01:43:29 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Flow 'volume_create_manager' (dfb05278-f374-4328-86e6-525f1fffb2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7d474b-6bd9-40c1-be01-55745ec4400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7d474b-6bd9-40c1-be01-55745ec4400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-338291851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4a09fd-7e7a-4638-ac63-f244c6fa45b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6f093075694292a500abac142b91b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:30Z,use_quota=True,user_id='a16982bc6b2440139df9af0b6561f72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70afd25-d753-41d4-a16d-7c4b9e269eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70afd25-d753-41d4-a16d-7c4b9e269eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c882d4fb-6249-40fe-80e9-b7e0eaa04dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c882d4fb-6249-40fe-80e9-b7e0eaa04dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4a09fd-7e7a-4638-ac63-f244c6fa45b7', 'volume_name': 'volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7', 'volume_size': 2}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c57643-c400-4cd2-9df7-7f7945826390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c57643-c400-4cd2-9df7-7f7945826390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b91b103-6885-4fb2-a969-492f65776aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Volume 4e4a09fd-7e7a-4638-ac63-f244c6fa45b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7', 'volume_size': 2} Sep 01 01:43:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:30 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa" returned: 0 in 0.533s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:30 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 Sep 01 01:43:30 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:30 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:30 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8 Sep 01 01:43:30 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:30 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa.f291ba92-e269-418f-ae7e-7eea147176b8" returned: 0 in 0.242s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-f291ba92-e269-418f-ae7e-7eea147176b8" released by "_delete_snapshot" :: held 1.605s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.953s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-c5036ec5-cf99-4388-9d55-06a7d4d85e9f req-75f2a802-031e-4713-b182-fd131fc249d2 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.140s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-c5036ec5-cf99-4388-9d55-06a7d4d85e9f req-75f2a802-031e-4713-b182-fd131fc249d2 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=44847d25-e788-41df-b551-6629fbb2215f,created_at=2026-08-31T23:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-401963409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44847d25-e788-41df-b551-6629fbb2215f,host='devstack@QuobyteHD#QuobyteHD',id=4d2c8ce3-af5f-43a9-9eac-bce340bfefa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf3bad03cc54b3ca69524e27b1a6a20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:29Z,use_quota=True,user_id='24fbde4a9f7d46338b58a0e04af9d65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dd092f3-56c1-4670-a8ce-f6c3f9e9870f),volume_type_id=5dd092f3-56c1-4670-a8ce-f6c3f9e9870f)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Creating volume 4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:30 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebfaa3c-b594-4b5e-9928-93bc809d8ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb', 'volume_size': 2, 'source_volid': '8859092f-509b-498e-bd9e-2b4e452871aa', 'source_volstatus': 'available'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:30 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 1073741824 Sep 01 01:43:30 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7fcf67-76e7-48b8-ad87-9e24df256906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Volume volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb (0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb): created successfully Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7fcf67-76e7-48b8-ad87-9e24df256906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Flow 'volume_create_manager' (4ad8a636-825e-443a-938f-42ca66a22acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-c5036ec5-cf99-4388-9d55-06a7d4d85e9f req-75f2a802-031e-4713-b182-fd131fc249d2 tempest-ServerActionsTestOtherA-2144573553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-c2280cc9-1796-4286-bd32-e5ac3efba993', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '834c7d7a-38f9-4e24-95e5-93c4ad302f35', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:43:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6b8eba3e-e9a2-4a40-a802-2d0720e2517b tempest-VolumesCloneTest-99467976 None] Created volume successfully. Sep 01 01:43:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-c5036ec5-cf99-4388-9d55-06a7d4d85e9f req-75f2a802-031e-4713-b182-fd131fc249d2 tempest-ServerActionsTestOtherA-2144573553 None] attachment_update completed successfully. Sep 01 01:43:31 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 1073741824" returned: 0 in 0.532s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Acquiring lock "cinder-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Lock "cinder-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:31 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 Sep 01 01:43:31 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Acquiring lock "cinder-quobyte-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" acquired by "delete_volume" :: waited 0.068s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6160f0d0-1564-4ebd-9e3a-263807935647]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:31 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" returned: 0 in 0.321s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-338291851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4a09fd-7e7a-4638-ac63-f244c6fa45b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c6f093075694292a500abac142b91b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:30Z,use_quota=True,user_id='a16982bc6b2440139df9af0b6561f72e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Creating volume 4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:31 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 2147483648 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:31 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb Sep 01 01:43:31 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ab7b5f-c5c4-4062-82c8-375b7f5d4e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:31 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 2147483648 Sep 01 01:43:31 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36593c8b-a6c0-4665-9e7d-9d6a3a0168a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:31 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Volume volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 (4d2c8ce3-af5f-43a9-9eac-bce340bfefa4): created successfully Sep 01 01:43:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36593c8b-a6c0-4665-9e7d-9d6a3a0168a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Flow 'volume_create_manager' (3f47a9fa-c352-4241-b6a8-35db6ae4cb86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-17e03e9d-1866-40e8-9c61-e3b64c4a9b20 tempest-GroupSnapshotsTest-313661701 None] Created volume successfully. Sep 01 01:43:32 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" returned: 0 in 0.617s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:32 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb Sep 01 01:43:32 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:32 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 2147483648" returned: 0 in 0.729s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:32 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 Sep 01 01:43:32 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:32 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" returned: 0 in 0.415s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb" released by "delete_volume" :: held 1.116s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Created reservations ['0dd50017-c076-4e79-8d63-7aef2b5d7dcf', 'a313a520-ea6f-465e-93f5-bdbbc86b49fe', '4f996ad3-23cf-47e3-bb20-42ca8b9fe371', 'ec667db6-fc5f-4fb0-9d7a-c4ec3d4bffa8'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:32 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7" returned: 0 in 0.338s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:32 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:32 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b91b103-6885-4fb2-a969-492f65776aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7', 'volume_size': 2}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94a9ffe-e614-4107-8583-2607753495da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Volume volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 (4e4a09fd-7e7a-4638-ac63-f244c6fa45b7): created successfully Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94a9ffe-e614-4107-8583-2607753495da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Flow 'volume_create_manager' (dfb05278-f374-4328-86e6-525f1fffb2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d70a3639-d46a-4abf-977c-5c8ee243cd6e tempest-VolumesCloneNegativeTest-1826635507 None] Created volume successfully. Sep 01 01:43:33 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Deleted volume successfully. Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-812a75af-155d-4b79-9376-b612fba3b950 tempest-VolumesCloneTest-99467976 None] Lock "cinder-0caa8c30-ad4a-4b0b-9c8a-e3697e3bb4fb-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Acquiring lock "cinder-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "cinder-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Acquiring lock "cinder-quobyte-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "cinder-quobyte-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a75092e-e1eb-464a-ad74-c4c6a9e0445b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:33 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 Sep 01 01:43:33 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] GroupSnapshot 785aa10b-6a8a-4c58-9615-51c9205f78a8: creating. Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Acquiring lock "cinder-8859092f-509b-498e-bd9e-2b4e452871aa-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Lock "cinder-8859092f-509b-498e-bd9e-2b4e452871aa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Group snapshot 785aa10b-6a8a-4c58-9615-51c9205f78a8: creating. {{(pid=87212) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Creating offline snapshot 00c4f510-c963-47b3-8ef2-1b8443aec7f0 of volume 4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a748fb8d-f4e1-402a-b6cc-ee3ec55bcdb2]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Acquiring lock "cinder-quobyte-8859092f-509b-498e-bd9e-2b4e452871aa" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-8859092f-509b-498e-bd9e-2b4e452871aa" acquired by "delete_volume" :: waited 0.047s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf4c429-4588-4aab-9d99-f07e903848d0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:34 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:34 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7" returned: 0 in 0.657s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:34 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:34 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa Sep 01 01:43:34 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7 Sep 01 01:43:34 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:34 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:34 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" returned: 0 in 0.604s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:34 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa" returned: 0 in 0.483s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:34 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 1G Sep 01 01:43:34 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:34 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa Sep 01 01:43:34 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:34 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7" returned: 0 in 0.524s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "cinder-quobyte-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7" released by "delete_volume" :: held 1.285s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:34 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Created reservations ['9ad3c0e7-5521-4801-8a7b-93351408986e', '0d174f66-9286-4f84-991a-a567ec318897', '6394b27f-d11c-474f-b4a3-ab36d746a4fc', 'e815e045-5d92-477a-8fdc-f810115c1e5b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:35 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8859092f-509b-498e-bd9e-2b4e452871aa" returned: 0 in 0.564s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:35 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Lock "cinder-quobyte-8859092f-509b-498e-bd9e-2b4e452871aa" released by "delete_volume" :: held 1.144s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:35 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Created reservations ['0c63f645-59ac-48c9-9925-5536fd70dbd2', '29543d2d-3e1c-4702-898d-6c01f268d224', '0da53b43-f996-4f0d-ae86-5dd1861e38ac', '581a3007-c15c-4aa1-941f-362ba825501d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:35 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:35 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:35 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 1G" returned: 0 in 0.984s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:35 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 Sep 01 01:43:35 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:35 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.579s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Deleted volume successfully. Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fb5cd297-7c4a-4503-928c-29e2ec2b276e tempest-VolumesCloneNegativeTest-1826635507 None] Lock "cinder-4e4a09fd-7e7a-4638-ac63-f244c6fa45b7-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:35 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.460s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Deleted volume successfully. Sep 01 01:43:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-66f7ce21-6e00-4ad0-86f3-bd8905c5b28b tempest-VolumesCloneTest-99467976 None] Lock "cinder-8859092f-509b-498e-bd9e-2b4e452871aa-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:36 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0" returned: 0 in 0.464s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:36 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:43:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:36 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 Sep 01 01:43:36 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:36 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0" returned: 0 in 0.390s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:36 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.info Sep 01 01:43:36 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:37 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.info" returned: 0 in 0.533s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:37 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:43:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:37 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.info Sep 01 01:43:37 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:37 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.info" returned: 0 in 0.482s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.637s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:37 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cc422b97-5ab0-4c22-820b-172d8eea7bf0 tempest-GroupSnapshotsTest-313661701 None] group_snapshot 785aa10b-6a8a-4c58-9615-51c9205f78a8: created successfully Sep 01 01:43:38 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] group_snapshot 785aa10b-6a8a-4c58-9615-51c9205f78a8: deleting Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] group_snapshot 785aa10b-6a8a-4c58-9615-51c9205f78a8: deleting {{(pid=87212) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-00c4f510-c963-47b3-8ef2-1b8443aec7f0" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-00c4f510-c963-47b3-8ef2-1b8443aec7f0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Deleting offline snapshot 00c4f510-c963-47b3-8ef2-1b8443aec7f0 of volume 4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] snapshot_file for this snap is: volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7eabdf-2fd7-4883-8115-09caff076b04]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:39 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 Sep 01 01:43:39 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:39 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0" returned: 0 in 0.632s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:43:39 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb51d093-4327-4fb7-9130-2bf727cd016d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:39 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 Sep 01 01:43:39 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:40 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" returned: 0 in 0.589s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:40 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 Sep 01 01:43:40 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:40 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0" returned: 0 in 0.527s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:40 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0 Sep 01 01:43:40 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:40 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4.00c4f510-c963-47b3-8ef2-1b8443aec7f0" returned: 0 in 0.312s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-00c4f510-c963-47b3-8ef2-1b8443aec7f0" released by "_delete_snapshot" :: held 2.215s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" released by "delete_snapshot" :: held 2.256s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:41 devstack cinder-volume[87212]: WARNING cinder.quota [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1551893291 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1551893291, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:43:41 devstack cinder-volume[87212]: WARNING cinder.quota [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1551893291 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1551893291, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] Created reservations ['3f047e48-effa-4984-96bc-a0ecb6a614d7', 'be508a63-49be-462b-aca7-85d114e024dc', 'd97b7d87-3a48-4be6-881d-ed653b61127d', '1a5ff238-4e81-47d9-b60f-f9ed0250c45b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a953459d-c7c3-46e9-bea9-0c2896cd05bb tempest-GroupSnapshotsTest-313661701 None] group_snapshot 785aa10b-6a8a-4c58-9615-51c9205f78a8: deleted successfully Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (c4351255-0c16-42dc-870a-d0eeabe96669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2920fae9-902c-4cb5-b05f-c7ffdb52c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2920fae9-902c-4cb5-b05f-c7ffdb52c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-286987962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:41Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc353ef-2067-4aff-96e1-6a951af6bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc353ef-2067-4aff-96e1-6a951af6bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7a85d8-abd3-4c7a-98fe-85b91b8e26ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7a85d8-abd3-4c7a-98fe-85b91b8e26ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1', 'volume_name': 'volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5112bae-c154-4947-a558-b54638fa7ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5112bae-c154-4947-a558-b54638fa7ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4943ff76-6c69-42bb-938b-1c4ad2b324e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Volume 1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1', 'volume_size': 1} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-286987962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:41Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Creating volume 1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:41 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:41 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 1073741824 Sep 01 01:43:41 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Flow 'volume_create_manager' (60c825be-65de-490b-ae69-6c3362faf71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aead4dd-1134-4439-b104-fd3662aaccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aead4dd-1134-4439-b104-fd3662aaccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1619563357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2da9a22-47a7-42cf-9365-0b580cb0aaed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34446d8b62ae49f9bc7e35d2371bfe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:42Z,use_quota=True,user_id='6102bb7212c54c6987cedf1eca42d1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398269bb-a599-450a-9277-5cb168386e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398269bb-a599-450a-9277-5cb168386e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251d08d-9408-45f4-9c59-6476d97140e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251d08d-9408-45f4-9c59-6476d97140e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2da9a22-47a7-42cf-9365-0b580cb0aaed', 'volume_name': 'volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed', 'volume_size': 2}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659daee9-719e-49fc-8f94-33d2d6077dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659daee9-719e-49fc-8f94-33d2d6077dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b76db9-9792-49d9-8447-2f84453220a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:41 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Volume c2da9a22-47a7-42cf-9365-0b580cb0aaed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed', 'volume_size': 2} Sep 01 01:43:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:42 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 1073741824" returned: 0 in 0.502s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:42 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 Sep 01 01:43:42 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:42 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1619563357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2da9a22-47a7-42cf-9365-0b580cb0aaed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34446d8b62ae49f9bc7e35d2371bfe24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:42Z,use_quota=True,user_id='6102bb7212c54c6987cedf1eca42d1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Creating volume c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:42 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed 2147483648 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4943ff76-6c69-42bb-938b-1c4ad2b324e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:42 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed 2147483648 Sep 01 01:43:42 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b24e9a-a5b5-4f9b-93b2-74e1d3d541da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:42 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Volume volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 (1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1): created successfully Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b24e9a-a5b5-4f9b-93b2-74e1d3d541da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (c4351255-0c16-42dc-870a-d0eeabe96669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fbf2c0ef-9688-4222-b7d0-4864aebbd1b8 tempest-VolumesGetTest-1059039115 None] Created volume successfully. Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "cinder-quobyte-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9346743e-0bcb-4ea8-b445-098017c41422]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:42 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 Sep 01 01:43:42 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:42 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed 2147483648" returned: 0 in 0.586s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:43 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed Sep 01 01:43:43 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:43 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" returned: 0 in 0.386s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:43 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4 Sep 01 01:43:43 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:43 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b76db9-9792-49d9-8447-2f84453220a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed', 'volume_size': 2}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816b311a-93fc-4a18-b10b-1aa58edf413c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Volume volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed (c2da9a22-47a7-42cf-9365-0b580cb0aaed): created successfully Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816b311a-93fc-4a18-b10b-1aa58edf413c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Flow 'volume_create_manager' (60c825be-65de-490b-ae69-6c3362faf71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e4ed4cc1-6b2a-4e59-9b55-97d748b270f5 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Created volume successfully. Sep 01 01:43:43 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Lock "cinder-quobyte-4d2c8ce3-af5f-43a9-9eac-bce340bfefa4" released by "delete_volume" :: held 0.704s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Created reservations ['857cd907-2d76-422a-9f0a-989b6296481e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:43 devstack cinder-volume[87212]: WARNING cinder.quota [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1551893291 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1551893291, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Created reservations ['b65b688d-2d3e-4376-a116-aedf8980f74f', 'd269120a-5319-43b9-97c4-a96095cb0773', '019f6e5c-6d19-4695-b804-5eabb708e91d', '270b53a1-1850-4733-a874-03ba6e628cd3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:43 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:43 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:44 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.465s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b0310409-b44c-4766-8401-bd45100e18ed tempest-GroupSnapshotsTest-313661701 None] Delete group completed successfully. Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Creating offline snapshot cad4e591-f427-4b0b-adda-41c482a723ae of volume c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[04397010-61c6-4e4e-878d-6851b4d82d93]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:44 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed Sep 01 01:43:44 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:44 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed" returned: 0 in 0.473s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae 2G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:44 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae 2G Sep 01 01:43:44 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (05271e23-588c-4eed-9a13-78e3339e8de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2f910b-ca78-413c-8979-e3c2e8825e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2f910b-ca78-413c-8979-e3c2e8825e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-654348001',display_name='tempest-VolumesGetTest-Volume-407460846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c870e47-0b17-4aed-83f9-4312befe8804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:45Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc37e87-6824-4d2e-9a52-1db39b109f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc37e87-6824-4d2e-9a52-1db39b109f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19964dc-4409-4f57-857d-97a26fa44535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19964dc-4409-4f57-857d-97a26fa44535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c870e47-0b17-4aed-83f9-4312befe8804', 'volume_name': 'volume-1c870e47-0b17-4aed-83f9-4312befe8804', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ca8589-6546-4ad8-8827-c92ab12c9765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ca8589-6546-4ad8-8827-c92ab12c9765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33929f1-6fde-4ba2-87fc-51b28931b97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:44 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Volume 1c870e47-0b17-4aed-83f9-4312befe8804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c870e47-0b17-4aed-83f9-4312befe8804', 'volume_size': 1} Sep 01 01:43:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:45 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae 2G" returned: 0 in 0.514s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:45 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae Sep 01 01:43:45 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:45 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae" returned: 0 in 0.325s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:45 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae is being set with open permissions: ugo+rw Sep 01 01:43:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:45 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae Sep 01 01:43:45 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:45 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae" returned: 0 in 0.322s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:45 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.info Sep 01 01:43:45 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:46 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.info" returned: 0 in 0.297s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:46 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.info is being set with open permissions: ugo+rw Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:46 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.info Sep 01 01:43:46 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:46 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.info" returned: 0 in 0.240s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-654348001',display_name='tempest-VolumesGetTest-Volume-407460846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c870e47-0b17-4aed-83f9-4312befe8804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:45Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Creating volume 1c870e47-0b17-4aed-83f9-4312befe8804 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:46 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:46 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 1073741824 Sep 01 01:43:46 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:46 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f47efc9f-4b0f-48d0-af9f-b7bc2b7e00ac tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Create snapshot completed successfully Sep 01 01:43:46 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 1073741824" returned: 0 in 0.459s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:47 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 Sep 01 01:43:47 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:47 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804" returned: 0 in 0.355s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "cinder-cad4e591-f427-4b0b-adda-41c482a723ae-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33929f1-6fde-4ba2-87fc-51b28931b97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c870e47-0b17-4aed-83f9-4312befe8804', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ff36f5-87fa-400e-b602-8d548f14f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-cad4e591-f427-4b0b-adda-41c482a723ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "cinder-quobyte-c2da9a22-47a7-42cf-9365-0b580cb0aaed" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:47 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Volume volume-1c870e47-0b17-4aed-83f9-4312befe8804 (1c870e47-0b17-4aed-83f9-4312befe8804): created successfully Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ff36f5-87fa-400e-b602-8d548f14f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (05271e23-588c-4eed-9a13-78e3339e8de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-quobyte-c2da9a22-47a7-42cf-9365-0b580cb0aaed" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "cinder-quobyte-cad4e591-f427-4b0b-adda-41c482a723ae" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8d9c1a8e-685a-4c3d-98c7-5dba89efccc1 tempest-VolumesGetTest-1059039115 None] Created volume successfully. Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-quobyte-cad4e591-f427-4b0b-adda-41c482a723ae" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Deleting offline snapshot cad4e591-f427-4b0b-adda-41c482a723ae of volume c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] snapshot_file for this snap is: volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8bff04-daf1-4216-9ae1-01324f778ab7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:47 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae Sep 01 01:43:47 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:47 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae" returned: 0 in 0.433s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0564b1-2439-4f85-9a83-826cb42f29fa]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-1c870e47-0b17-4aed-83f9-4312befe8804-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Lock "cinder-1c870e47-0b17-4aed-83f9-4312befe8804-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-1c870e47-0b17-4aed-83f9-4312befe8804" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:48 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-1c870e47-0b17-4aed-83f9-4312befe8804" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:48 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda694bf-30f0-48a4-b4fa-417d91b00b15]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:48 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 Sep 01 01:43:48 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:48 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed" returned: 0 in 0.585s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:48 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae Sep 01 01:43:48 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:48 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804" returned: 0 in 0.493s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:48 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804 Sep 01 01:43:48 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:49 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae" returned: 0 in 0.477s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:49 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae Sep 01 01:43:49 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:49 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1c870e47-0b17-4aed-83f9-4312befe8804" returned: 0 in 0.397s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-1c870e47-0b17-4aed-83f9-4312befe8804" released by "delete_volume" :: held 0.957s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Created reservations ['604e78b1-8c10-4066-8d38-e522ee86283d', '5fa1e3c1-a9e7-43c5-a755-089d572db60a', 'f48d18f1-8a22-4317-baad-6f6bd1cb4085', 'a3e7a0ca-e38a-48bd-8c71-47048d638da3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:49 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:49 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:49 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed.cad4e591-f427-4b0b-adda-41c482a723ae" returned: 0 in 0.390s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-quobyte-cad4e591-f427-4b0b-adda-41c482a723ae" released by "_delete_snapshot" :: held 2.067s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-quobyte-c2da9a22-47a7-42cf-9365-0b580cb0aaed" released by "delete_snapshot" :: held 2.110s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Created reservations ['cc9caf98-cb91-4475-bd38-d84a2b2bc955', '1cac8ed8-e5b2-47a6-8d0a-b12a924773ce', 'c767d313-fe69-412c-abf5-d538cb8127e6', '96e59223-a738-44c6-880a-3311b9d9c13f'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Delete snapshot completed successfully. Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-453178dd-7dc7-445b-94dc-701342273483 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-cad4e591-f427-4b0b-adda-41c482a723ae-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:49 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Deleted volume successfully. Sep 01 01:43:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-589ab71d-7e01-4a8c-ba86-1bd8f8f038db tempest-VolumesGetTest-1059039115 None] Lock "cinder-1c870e47-0b17-4aed-83f9-4312befe8804-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=184,cinder:UPDATE=222,cinder:INSERT=59,cinder:DELETE=10 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:43:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5099d35c-65bc-481c-8745-7bfe24c1760c tempest-GroupsV314Test-928569584 None] Group tempest-GroupsV314Test-Group-1920326941: creating Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=211,cinder:SELECT=204,cinder:INSERT=54,cinder:DELETE=16 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Lock "cinder-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5099d35c-65bc-481c-8745-7bfe24c1760c tempest-GroupsV314Test-928569584 None] Group tempest-GroupsV314Test-Group-1920326941: created successfully Sep 01 01:43:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5099d35c-65bc-481c-8745-7bfe24c1760c tempest-GroupsV314Test-928569584 None] Create group completed successfully. Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf3ea2-055f-4a59-b297-57af186fa4ff]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "cinder-c2da9a22-47a7-42cf-9365-0b580cb0aaed-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-c2da9a22-47a7-42cf-9365-0b580cb0aaed-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "cinder-quobyte-c2da9a22-47a7-42cf-9365-0b580cb0aaed" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-quobyte-c2da9a22-47a7-42cf-9365-0b580cb0aaed" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:50 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 Sep 01 01:43:50 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b814ba9-3b16-4bec-b859-3b21e35bfecc]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:50 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed Sep 01 01:43:50 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:51 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1" returned: 0 in 0.427s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:51 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1 Sep 01 01:43:51 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:51 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed" returned: 0 in 0.377s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:51 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed Sep 01 01:43:51 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:51 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1" returned: 0 in 0.291s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1" released by "delete_volume" :: held 0.756s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Created reservations ['bfd97361-c10d-4918-a398-88db0feaed10', 'd70530f5-47e6-43a0-84f1-62b4749a679f', '366d41cd-11e7-4ba0-93d3-375b054ed8de', '495b588c-cc59-43d9-8fc9-48a1b867057a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:51 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2da9a22-47a7-42cf-9365-0b580cb0aaed" returned: 0 in 0.251s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-quobyte-c2da9a22-47a7-42cf-9365-0b580cb0aaed" released by "delete_volume" :: held 0.700s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:51 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:51 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Created reservations ['b6dfc9bb-a273-4f37-b53b-d98a3b9173cd', 'fa7dddd2-cac9-4b91-a67b-1295441849f5', 'a889d89a-5547-4204-8b99-c91a6367afee', '4c7fa3c7-5f35-4634-9ad4-ce6908f85b28'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:51 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:43:51 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:51 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.323s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:51 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Deleted volume successfully. Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-81cb9193-4d31-4c4d-98c9-c7267d798689 tempest-VolumesGetTest-1059039115 None] Lock "cinder-1ce2b2b0-6b4e-4e7e-a961-6f4e1f9c63c1-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:51 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.314s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:51 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:43:51 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Deleted volume successfully. Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a0272a52-bbe4-4769-976b-7be14ca1ea39 tempest-VolumesSnapshotNegativeTestJSON-1975905619 None] Lock "cinder-c2da9a22-47a7-42cf-9365-0b580cb0aaed-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (c367b505-44ec-4baa-ab67-a91496145487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10f56a1-f718-4028-92b5-68753d4250ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10f56a1-f718-4028-92b5-68753d4250ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1792181111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca152f06-ddff-40cf-83ee-e9d7ccc556c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:52Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3cb4f5-8e6e-4e26-80c0-335bd168ed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3cb4f5-8e6e-4e26-80c0-335bd168ed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915051b0-ae97-4a55-b064-a91be8fea165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915051b0-ae97-4a55-b064-a91be8fea165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca152f06-ddff-40cf-83ee-e9d7ccc556c6', 'volume_name': 'volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7646c3-1251-4735-834f-acc515b2d65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7646c3-1251-4735-834f-acc515b2d65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935fa5fc-5416-4664-b762-181c0b11bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Volume ca152f06-ddff-40cf-83ee-e9d7ccc556c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6', 'volume_size': 1} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1792181111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca152f06-ddff-40cf-83ee-e9d7ccc556c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:52Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Creating volume ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:52 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:52 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 1073741824 Sep 01 01:43:52 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Flow 'volume_create_manager' (008cb37e-d101-417e-ba51-442d79aad07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7101904c-92a5-4c3c-8e58-71b6a290b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7101904c-92a5-4c3c-8e58-71b6a290b041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1625618084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a5a85ff-8003-49cb-bb14-9c4654c0ef47,host='devstack@QuobyteHD#QuobyteHD',id=7a30c386-f09a-48d3-92a2-147e00646e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13b974d1b6d4e49a157019227cf94cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:52Z,use_quota=True,user_id='013a2fabd23141dfaf6cd64f86e8ac1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0d6ed90-48b0-459b-bbe5-1aa6ec68cafa),volume_type_id=b0d6ed90-48b0-459b-bbe5-1aa6ec68cafa)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4620a3fc-7d78-4926-bba1-56d96a972c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4620a3fc-7d78-4926-bba1-56d96a972c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dc4aba-c0ea-4fd3-bec2-74d4728a85ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dc4aba-c0ea-4fd3-bec2-74d4728a85ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a30c386-f09a-48d3-92a2-147e00646e85', 'volume_name': 'volume-7a30c386-f09a-48d3-92a2-147e00646e85', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d194d71-375f-4ea0-870c-26b4c2e43f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d194d71-375f-4ea0-870c-26b4c2e43f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a844f24-e38d-4f12-bbbd-6064f71ec960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Volume 7a30c386-f09a-48d3-92a2-147e00646e85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a30c386-f09a-48d3-92a2-147e00646e85', 'volume_size': 1} Sep 01 01:43:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:53 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 1073741824" returned: 0 in 0.498s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:53 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 Sep 01 01:43:53 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:53 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" returned: 0 in 0.279s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6a5a85ff-8003-49cb-bb14-9c4654c0ef47,created_at=2026-08-31T23:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1625618084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6a5a85ff-8003-49cb-bb14-9c4654c0ef47,host='devstack@QuobyteHD#QuobyteHD',id=7a30c386-f09a-48d3-92a2-147e00646e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d13b974d1b6d4e49a157019227cf94cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:52Z,use_quota=True,user_id='013a2fabd23141dfaf6cd64f86e8ac1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0d6ed90-48b0-459b-bbe5-1aa6ec68cafa),volume_type_id=b0d6ed90-48b0-459b-bbe5-1aa6ec68cafa)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Creating volume 7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:43:53 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935fa5fc-5416-4664-b762-181c0b11bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:53 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 1073741824 Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e825de9b-d55e-41ad-bba4-242a86720a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:53 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:53 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Volume volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 (ca152f06-ddff-40cf-83ee-e9d7ccc556c6): created successfully Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e825de9b-d55e-41ad-bba4-242a86720a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (c367b505-44ec-4baa-ab67-a91496145487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c72b06d6-89be-4544-9882-02690cc973c3 tempest-VolumesGetTest-1059039115 None] Created volume successfully. Sep 01 01:43:53 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 1073741824" returned: 0 in 0.448s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:53 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 Sep 01 01:43:53 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:54 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85" returned: 0 in 0.247s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a844f24-e38d-4f12-bbbd-6064f71ec960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a30c386-f09a-48d3-92a2-147e00646e85', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67266d65-3cbf-43e9-916f-b427b9ee0d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:54 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Volume volume-7a30c386-f09a-48d3-92a2-147e00646e85 (7a30c386-f09a-48d3-92a2-147e00646e85): created successfully Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67266d65-3cbf-43e9-916f-b427b9ee0d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Flow 'volume_create_manager' (008cb37e-d101-417e-ba51-442d79aad07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:54 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bd4834b4-44de-439f-a033-8c67cd3cd651 tempest-GroupsV314Test-928569584 None] Created volume successfully. Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (379c05e6-6cf3-4e02-b2d2-de8c02dc0873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465a53e5-7f1b-48a8-b770-5d838c9bea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465a53e5-7f1b-48a8-b770-5d838c9bea20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-346090617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960946e1-6de5-4dc8-a418-8a2b02fdf661,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ca152f06-ddff-40cf-83ee-e9d7ccc556c6,status='creating',terminated_at=None,updated_at=2026-08-31T23:43:55Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e7430e-574c-4d9d-8312-2eb07141317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e7430e-574c-4d9d-8312-2eb07141317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9df92c-2b90-40dd-9879-49ba0a6c9787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c9df92c-2b90-40dd-9879-49ba0a6c9787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '960946e1-6de5-4dc8-a418-8a2b02fdf661', 'volume_name': 'volume-960946e1-6de5-4dc8-a418-8a2b02fdf661', 'volume_size': 1, 'source_volid': 'ca152f06-ddff-40cf-83ee-e9d7ccc556c6', 'source_volstatus': 'available'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fb2952-9cfe-4a9e-a167-45bd9c593e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fb2952-9cfe-4a9e-a167-45bd9c593e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd4413c-d335-4033-8361-5388606c6c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:43:55 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Volume 960946e1-6de5-4dc8-a418-8a2b02fdf661: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-960946e1-6de5-4dc8-a418-8a2b02fdf661', 'volume_size': 1, 'source_volid': 'ca152f06-ddff-40cf-83ee-e9d7ccc556c6', 'source_volstatus': 'available'} Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:55 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Cloning volume ca152f06-ddff-40cf-83ee-e9d7ccc556c6 to volume 960946e1-6de5-4dc8-a418-8a2b02fdf661 Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Creating offline snapshot d4baf346-681c-4b7b-a15e-02d0b43cdfda of volume ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac4974e-7be3-4da5-8170-10aaed19998e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:55 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 Sep 01 01:43:55 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:55 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" returned: 0 in 0.425s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:55 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda 1G Sep 01 01:43:55 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:56 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda 1G" returned: 0 in 0.494s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:56 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda Sep 01 01:43:56 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:56 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda" returned: 0 in 0.298s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:56 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda is being set with open permissions: ugo+rw Sep 01 01:43:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:56 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda Sep 01 01:43:56 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:56 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda" returned: 0 in 0.284s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:56 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.info Sep 01 01:43:56 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:57 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.info" returned: 0 in 0.341s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:57 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.info is being set with open permissions: ugo+rw Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:57 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.info Sep 01 01:43:57 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:57 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.info" returned: 0 in 0.254s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-960946e1-6de5-4dc8-a418-8a2b02fdf661" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-960946e1-6de5-4dc8-a418-8a2b02fdf661" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] snapshot: d4baf346-681c-4b7b-a15e-02d0b43cdfda, volume: 960946e1-6de5-4dc8-a418-8a2b02fdf661, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8ed0c2-c8ea-4e18-b7db-b2b99586abd0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:57 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda Sep 01 01:43:57 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:57 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda" returned: 0 in 0.420s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5479f32f-11b5-4edb-b37b-b9a28ddc136a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:43:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:57 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 Sep 01 01:43:57 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:43:58 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 01 01:43:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" returned: 0 in 0.501s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:43:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:43:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:43:58 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:43:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:43:58 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 Sep 01 01:43:58 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:04 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661" returned: 0 in 5.864s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:44:04 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Converted 1024.00 MB image at 174.58 MB/s Sep 01 01:44:04 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 is being set with open permissions: ugo+rw Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:04 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 Sep 01 01:44:04 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:04 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-960946e1-6de5-4dc8-a418-8a2b02fdf661" released by "_copy_volume_from_snapshot" :: held 7.157s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-d4baf346-681c-4b7b-a15e-02d0b43cdfda" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-d4baf346-681c-4b7b-a15e-02d0b43cdfda" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Deleting offline snapshot d4baf346-681c-4b7b-a15e-02d0b43cdfda of volume ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] snapshot_file for this snap is: volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[740eae84-33c4-42eb-989a-d4c50ec26472]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:04 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda Sep 01 01:44:04 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:04 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda" returned: 0 in 0.460s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e29d0e7-88d1-4cd2-bd1b-fb7a1c7fbdda]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:05 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 Sep 01 01:44:05 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-4ef855af-f79a-4b9d-996d-e472aaeaaf6c tempest-ServerActionsTestOtherA-2144573553 None] Terminate volume connection completed successfully. Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-4ef855af-f79a-4b9d-996d-e472aaeaaf6c tempest-ServerActionsTestOtherA-2144573553 None] Deleting attachment 834c7d7a-38f9-4e24-95e5-93c4ad302f35. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:44:05 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "cinder-c2280cc9-1796-4286-bd32-e5ac3efba993-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" returned: 0 in 0.636s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-c2280cc9-1796-4286-bd32-e5ac3efba993-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:05 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda Sep 01 01:44:05 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "cinder-quobyte-c2280cc9-1796-4286-bd32-e5ac3efba993" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-quobyte-c2280cc9-1796-4286-bd32-e5ac3efba993" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32ab0c-97cc-4c07-8c4e-ee7b4b577ff3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:06 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda" returned: 0 in 0.480s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:06 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 Sep 01 01:44:06 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:06 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda Sep 01 01:44:06 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:06 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6.d4baf346-681c-4b7b-a15e-02d0b43cdfda" returned: 0 in 0.353s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-d4baf346-681c-4b7b-a15e-02d0b43cdfda" released by "_delete_snapshot" :: held 2.046s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:06 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993" returned: 0 in 0.599s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:06 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993 Sep 01 01:44:06 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.585s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.233s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:06 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Cloning volume 7a30c386-f09a-48d3-92a2-147e00646e85 to volume 18ad5e65-d5bf-4f0a-9134-94fe2df55f58 Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd4413c-d335-4033-8361-5388606c6c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960946e1-6de5-4dc8-a418-8a2b02fdf661', 'volume_size': 1, 'source_volid': 'ca152f06-ddff-40cf-83ee-e9d7ccc556c6', 'source_volstatus': 'available'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232d6f5e-aecb-431a-ac6b-48579448a467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:06 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Volume volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 (960946e1-6de5-4dc8-a418-8a2b02fdf661): created successfully Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232d6f5e-aecb-431a-ac6b-48579448a467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (379c05e6-6cf3-4e02-b2d2-de8c02dc0873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Creating offline snapshot f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 of volume 7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "cinder-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:06 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8d156800-afcc-4826-afbd-c5bf975e0594 tempest-VolumesGetTest-1059039115 None] Created volume successfully. Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d879d8-9c1b-4554-abac-1e5a576d42dd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "cinder-quobyte-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-quobyte-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cdbc8a-857a-4305-b333-9b5a84a31b28]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:06 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 Sep 01 01:44:06 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:06 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c2280cc9-1796-4286-bd32-e5ac3efba993" returned: 0 in 0.372s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-quobyte-c2280cc9-1796-4286-bd32-e5ac3efba993" released by "delete_volume" :: held 1.044s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:07 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 Sep 01 01:44:07 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.quota [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Created reservations ['df3f49aa-1008-4ae5-be87-fb92ee694f77', 'a98ff7cc-1cc8-47ff-bfc2-b94d04d401c4', 'f5e63f86-56c2-4028-ad78-e294167e665a', '5ba25030-59a0-428b-be63-27160de4e83a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:07 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:07 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:07 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85" returned: 0 in 0.566s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:07 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 1G Sep 01 01:44:07 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:07 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6" returned: 0 in 0.543s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:07 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6 Sep 01 01:44:07 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:07 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.362s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.manager [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Deleted volume successfully. Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-acd6b1e4-e0bc-4991-a920-3e6ed09a6064 req-b203fa78-2ca8-451a-a2dd-4fc147051ba3 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-c2280cc9-1796-4286-bd32-e5ac3efba993-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:07 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6" returned: 0 in 0.377s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-quobyte-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6" released by "delete_volume" :: held 0.980s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Created reservations ['a7b5439f-5440-4be1-80d3-9eed2d0ab3e4', '6dbaa7bd-45b6-48cd-928d-b4bcee8b9874', '29524aab-7a66-40f9-9368-4c547501dcc8', '3ce4b2ba-597c-4734-9177-21ed9c7099bf'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:08 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 1G" returned: 0 in 0.696s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a30c386-f09a-48d3-92a2-147e00646e85 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:08 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:08 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:08 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a30c386-f09a-48d3-92a2-147e00646e85 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 Sep 01 01:44:08 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:08 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.321s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Deleted volume successfully. Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-926e0acd-ecfc-4abc-a909-5473d4f9eb03 tempest-ServerActionsTestOtherA-2144573553 None] Lock "cinder-ae542631-f3f3-48ce-bfe8-3e1cbf34cad6-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:08 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a30c386-f09a-48d3-92a2-147e00646e85 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" returned: 0 in 0.387s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:08 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:08 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 Sep 01 01:44:08 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (fbf336e8-5830-41a0-af0d-5a60d6ddee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9b7564-d49a-49df-83c4-079ca14baea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9b7564-d49a-49df-83c4-079ca14baea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-211003101',display_name='tempest-VolumesGetTest-Volume-1036686787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad79f6d4-e079-46f7-a30c-ae4e612f2834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:08Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6b3348-2a74-4670-8886-212a6bdea96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6b3348-2a74-4670-8886-212a6bdea96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e15e2e-e547-4a28-87f6-87b67d949bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e15e2e-e547-4a28-87f6-87b67d949bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad79f6d4-e079-46f7-a30c-ae4e612f2834', 'volume_name': 'volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1f12aa-91b0-48cd-aa29-3b64fd52d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1f12aa-91b0-48cd-aa29-3b64fd52d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0462ee33-949b-491c-87a1-8c4e8a2a6bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:08 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Volume ad79f6d4-e079-46f7-a30c-ae4e612f2834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834', 'volume_size': 1} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:08 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" returned: 0 in 0.263s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:08 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.info Sep 01 01:44:08 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:08 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.info" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:08 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:44:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:08 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.info Sep 01 01:44:08 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:09 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.info" returned: 0 in 0.394s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Acquiring lock "cinder-quobyte-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] snapshot: f98a4b9e-3e1e-4085-95f7-f724a14f2ce6, volume: 18ad5e65-d5bf-4f0a-9134-94fe2df55f58, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c837f4ff-dec1-481e-a8c9-0dd7eb876dc2]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:09 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 Sep 01 01:44:09 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:10 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" returned: 0 in 0.595s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a30c386-f09a-48d3-92a2-147e00646e85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a345b0d4-24ea-4274-a55f-8aa2c159b507]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:10 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 Sep 01 01:44:10 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:10 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85" returned: 0 in 0.395s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:44:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:10 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 Sep 01 01:44:10 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:15 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" returned: 0 in 5.370s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:15 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:44:15 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Converted 1024.00 MB image at 190.65 MB/s Sep 01 01:44:15 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 01:44:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:15 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 Sep 01 01:44:15 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:16 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" returned: 0 in 0.283s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" released by "_copy_volume_from_snapshot" :: held 6.737s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Acquiring lock "cinder-quobyte-f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Deleting offline snapshot f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 of volume 7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] snapshot_file for this snap is: volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c9e023-91d4-47ae-aa5e-7589b2dabf5a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:16 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 Sep 01 01:44:16 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:16 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a30c386-f09a-48d3-92a2-147e00646e85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[02107121-9f7a-4ebf-8fad-7993f7b08dee]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:16 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 Sep 01 01:44:16 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:17 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:17 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:17 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85" returned: 0 in 0.638s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:17 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 Sep 01 01:44:17 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:17 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.359s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:44:17 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" returned: 0 in 0.489s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:17 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6 Sep 01 01:44:17 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:18 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85.f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" returned: 0 in 0.307s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-f98a4b9e-3e1e-4085-95f7-f724a14f2ce6" released by "_delete_snapshot" :: held 1.934s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.516s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.502s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-211003101',display_name='tempest-VolumesGetTest-Volume-1036686787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad79f6d4-e079-46f7-a30c-ae4e612f2834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:08Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Creating volume ad79f6d4-e079-46f7-a30c-ae4e612f2834 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:18 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:18 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 1073741824 Sep 01 01:44:18 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-dfb912cd-d076-4b8c-a1d8-8611ee163edb tempest-GroupsV314Test-928569584 None] Create group from source-group-6a5a85ff-8003-49cb-bb14-9c4654c0ef47 completed successfully. Sep 01 01:44:18 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 1073741824" returned: 0 in 0.645s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:18 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 Sep 01 01:44:18 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:19 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834" returned: 0 in 0.286s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0462ee33-949b-491c-87a1-8c4e8a2a6bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e45103d-f69b-42df-82cf-7183a0f8ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:19 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Volume volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 (ad79f6d4-e079-46f7-a30c-ae4e612f2834): created successfully Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e45103d-f69b-42df-82cf-7183a0f8ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (fbf336e8-5830-41a0-af0d-5a60d6ddee84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:19 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9258b7f9-7eab-434b-a924-bf465d26d064 tempest-VolumesGetTest-1059039115 None] Created volume successfully. Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Acquiring lock "cinder-quobyte-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa6fd1e-9b9f-4869-91fc-609927192afc]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-ad79f6d4-e079-46f7-a30c-ae4e612f2834-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:19 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 Sep 01 01:44:19 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Lock "cinder-ad79f6d4-e079-46f7-a30c-ae4e612f2834-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-ad79f6d4-e079-46f7-a30c-ae4e612f2834" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-ad79f6d4-e079-46f7-a30c-ae4e612f2834" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5cccdd-1f2d-44fd-949a-ef53e9076686]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:20 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 Sep 01 01:44:20 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:20 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" returned: 0 in 0.500s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:20 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58 Sep 01 01:44:20 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:20 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834" returned: 0 in 0.510s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:20 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834 Sep 01 01:44:20 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:20 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" returned: 0 in 0.355s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-18ad5e65-d5bf-4f0a-9134-94fe2df55f58" released by "delete_volume" :: held 0.936s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Created reservations ['ba3ac78c-9fce-4d72-be8e-12caa83ec7c6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:20 devstack cinder-volume[87212]: WARNING cinder.quota [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1389168155 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1389168155, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:44:20 devstack cinder-volume[87212]: WARNING cinder.quota [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1389168155 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1389168155, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:44:20 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad79f6d4-e079-46f7-a30c-ae4e612f2834" returned: 0 in 0.326s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Created reservations ['5a42cc66-4bca-4a40-83cd-168aac67cf9d', 'a701e780-6eb6-4e57-8172-21c7c01cca56', '03d4e05d-ab1c-4dd7-b05b-37295870117c', '58d917ec-cde7-4f9d-a952-6215f6f4610a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-ad79f6d4-e079-46f7-a30c-ae4e612f2834" released by "delete_volume" :: held 0.925s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Created reservations ['c9cf526a-ece1-4829-8bb8-b03e0c5b6066', '96aad884-bca0-44c9-b10a-62f38005cb2d', 'e207fb70-5136-4437-8245-95d2f65bd430', '93185099-8856-4e40-b368-cc22746ad331'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:21 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:21 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:21 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:21 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:21 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-af77280a-16f8-4ab5-a533-336039bccce9 tempest-GroupsV314Test-928569584 None] Delete group completed successfully. Sep 01 01:44:21 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.319s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Deleted volume successfully. Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Acquiring lock "cinder-quobyte-7a30c386-f09a-48d3-92a2-147e00646e85" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-7a30c386-f09a-48d3-92a2-147e00646e85" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e54d1fca-dbde-4072-b26b-1682f9ef64f4 tempest-VolumesGetTest-1059039115 None] Lock "cinder-ad79f6d4-e079-46f7-a30c-ae4e612f2834-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02535a-acfa-456d-92e2-b1940486d0a7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:21 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 Sep 01 01:44:21 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:22 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85" returned: 0 in 0.449s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:22 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85 Sep 01 01:44:22 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:22 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7a30c386-f09a-48d3-92a2-147e00646e85" returned: 0 in 0.351s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-960946e1-6de5-4dc8-a418-8a2b02fdf661-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Lock "cinder-quobyte-7a30c386-f09a-48d3-92a2-147e00646e85" released by "delete_volume" :: held 0.887s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Lock "cinder-960946e1-6de5-4dc8-a418-8a2b02fdf661-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-960946e1-6de5-4dc8-a418-8a2b02fdf661" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-960946e1-6de5-4dc8-a418-8a2b02fdf661" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Created reservations ['79f0f1e4-1ca0-43fb-8d38-7ea231337d64'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f37906-f54e-41c6-b04a-4a457c6d5ead]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:22 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Created reservations ['43d25a8f-2cba-4fb0-887b-369cd4ac74eb', '40dd3aaa-a8a4-46be-9a86-9d0537f1d15a', 'a680262f-c2d0-4421-8cee-3bdf2d56fc4f', '96692c19-c45d-42cb-8c60-5228e6566bae'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:22 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 Sep 01 01:44:22 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:23 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:23 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:23 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661" returned: 0 in 0.669s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:23 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661 Sep 01 01:44:23 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:23 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-960946e1-6de5-4dc8-a418-8a2b02fdf661" returned: 0 in 0.410s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:23 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.560s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-960946e1-6de5-4dc8-a418-8a2b02fdf661" released by "delete_volume" :: held 1.145s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b5d63b94-ce84-4922-89b3-9200fb2d52c0 tempest-GroupsV314Test-928569584 None] Delete group completed successfully. Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Created reservations ['956d3e0b-3483-461b-9630-64070d4bd771', '7987884d-7505-4637-bac4-81c0c2cecc45', '1caa8b93-ca55-4c72-9892-510abbc01136', '3ab2f8cc-a652-43d9-ba29-2c74eeeb05f5'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:24 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:24 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:24 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.532s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:24 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:24 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Deleted volume successfully. Sep 01 01:44:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-414e6f84-3c2a-44b2-8194-53eff7e6f5db tempest-VolumesGetTest-1059039115 None] Lock "cinder-960946e1-6de5-4dc8-a418-8a2b02fdf661-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-ca152f06-ddff-40cf-83ee-e9d7ccc556c6-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Lock "cinder-ca152f06-ddff-40cf-83ee-e9d7ccc556c6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[27327aac-5c08-4202-8cb4-af21c96de2fd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:25 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 Sep 01 01:44:25 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:25 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" returned: 0 in 0.464s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:25 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6 Sep 01 01:44:25 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:25 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-ca152f06-ddff-40cf-83ee-e9d7ccc556c6" released by "delete_volume" :: held 0.820s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Created reservations ['173b4a0d-49e4-493e-a55b-6730e01a2854', '36f98b3d-44f8-4d97-bf1c-2f0bf2328133', '54519384-c2d4-4ee2-a369-c3a6e07d5ee7', '4d5a2618-6d46-44b5-837c-9daded296746'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:26 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:26 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:26 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.376s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:26 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:26 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Deleted volume successfully. Sep 01 01:44:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6f906663-0ddd-460a-950c-0a1985a2b35e tempest-VolumesGetTest-1059039115 None] Lock "cinder-ca152f06-ddff-40cf-83ee-e9d7ccc556c6-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (8b3df192-ba9d-4c58-b109-63c5d74dfa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4681c1f8-361f-41c3-ac76-7a987d6ea0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4681c1f8-361f-41c3-ac76-7a987d6ea0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2135816435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dde8fc-da5b-4335-b639-85a96db77a81,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:27Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4905de88-0dad-4958-a3c2-6047e81573e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4905de88-0dad-4958-a3c2-6047e81573e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a21626-68a7-4037-a7da-5e01d6191195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:27 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a21626-68a7-4037-a7da-5e01d6191195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64dde8fc-da5b-4335-b639-85a96db77a81', 'volume_name': 'volume-64dde8fc-da5b-4335-b639-85a96db77a81', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d888b697-5746-4b12-aa83-741467b937b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d888b697-5746-4b12-aa83-741467b937b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5240dd-dc0f-4b7b-bb4f-41c2596e7daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Volume 64dde8fc-da5b-4335-b639-85a96db77a81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64dde8fc-da5b-4335-b639-85a96db77a81', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Trying to clone 64dde8fc-da5b-4335-b639-85a96db77a81 from image babec01a-b62a-4774-aa41-a35db0f34a47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:44:28 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c7d039-27a7-4510-9307-e780cb0abd4b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:28 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD Sep 01 01:44:28 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:28 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:28 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 is fetched for user 7f53e4f69e7149389ce2b89fe22e6f51. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1afc516-2158-42c1-829f-bec2b9a10e28]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:29 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD Sep 01 01:44:29 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:29 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2135816435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dde8fc-da5b-4335-b639-85a96db77a81,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:27Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Creating volume 64dde8fc-da5b-4335-b639-85a96db77a81 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:29 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:29 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 1073741824 Sep 01 01:44:29 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:30 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 1073741824" returned: 0 in 0.610s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:30 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 Sep 01 01:44:30 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:30 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81" returned: 0 in 0.279s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Attempting download of babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume 64dde8fc-da5b-4335-b639-85a96db77a81. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a423a007-6592-4de7-88f3-a500175b768c]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_4orb1fzr {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:30 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_4orb1fzr Sep 01 01:44:30 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:31 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_4orb1fzr" returned: 0 in 0.418s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_4orb1fzr {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:31 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_4orb1fzr Sep 01 01:44:31 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:31 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_4orb1fzr" returned: 1 in 0.416s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_4orb1fzr' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84123f0-5890-4478-8659-214de9391d46]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:31 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD Sep 01 01:44:31 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:31 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] babec01a-b62a-4774-aa41-a35db0f34a47 was qcow2, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:44:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:31 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 Sep 01 01:44:31 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:34 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81" returned: 0 in 2.665s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:34 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_wj362x4kdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:44:34 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Converted 112.00 MB image at 42.00 MB/s Sep 01 01:44:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:34 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 1G Sep 01 01:44:34 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:35 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 1G" returned: 0 in 0.559s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Downloaded image babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume 64dde8fc-da5b-4335-b639-85a96db77a81 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 for user 7f53e4f69e7149389ce2b89fe22e6f51 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Marking volume 64dde8fc-da5b-4335-b639-85a96db77a81 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Copying metadata from image babec01a-b62a-4774-aa41-a35db0f34a47 to 64dde8fc-da5b-4335-b639-85a96db77a81. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Creating volume glance metadata for volume 64dde8fc-da5b-4335-b639-85a96db77a81 backed by image babec01a-b62a-4774-aa41-a35db0f34a47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5240dd-dc0f-4b7b-bb4f-41c2596e7daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64dde8fc-da5b-4335-b639-85a96db77a81', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860088ff-56f9-41b1-beef-c41be4987541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:35 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Volume volume-64dde8fc-da5b-4335-b639-85a96db77a81 (64dde8fc-da5b-4335-b639-85a96db77a81): created successfully Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860088ff-56f9-41b1-beef-c41be4987541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (8b3df192-ba9d-4c58-b109-63c5d74dfa2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ac49de1a-36a0-4589-a3a1-9c2bea7db6c2 tempest-VolumesGetTest-1059039115 None] Created volume successfully. Sep 01 01:44:36 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (ba5fff39-d26c-4f61-be81-40de26578ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ef7569-23ec-45f6-8512-bff9d7a630d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ef7569-23ec-45f6-8512-bff9d7a630d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-196703077',display_name='tempest-VolumesGetTest-Volume-1031657995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0530ffd8-9b0c-4a93-bcfa-c52f05d28612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:37Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaaf086-edc6-4981-8ea6-f6e32089398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaaf086-edc6-4981-8ea6-f6e32089398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5f7c76-9948-4897-82fc-b98ebf2cb0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5f7c76-9948-4897-82fc-b98ebf2cb0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0530ffd8-9b0c-4a93-bcfa-c52f05d28612', 'volume_name': 'volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5dcb4a-4fb4-4bf5-ab21-8b20030783e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5dcb4a-4fb4-4bf5-ab21-8b20030783e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e5e12c-549b-40ea-a49a-f79b664659f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:37 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Volume 0530ffd8-9b0c-4a93-bcfa-c52f05d28612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612', 'volume_size': 1} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-196703077',display_name='tempest-VolumesGetTest-Volume-1031657995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0530ffd8-9b0c-4a93-bcfa-c52f05d28612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db06f66def84857b93c403412aba89c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:37Z,use_quota=True,user_id='7f53e4f69e7149389ce2b89fe22e6f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Creating volume 0530ffd8-9b0c-4a93-bcfa-c52f05d28612 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:37 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:37 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 1073741824 Sep 01 01:44:37 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:38 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 1073741824" returned: 0 in 0.929s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:38 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 Sep 01 01:44:38 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:38 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612" returned: 0 in 0.383s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e5e12c-549b-40ea-a49a-f79b664659f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c08cf-3014-430f-af1c-cd33e8d1f9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Volume volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 (0530ffd8-9b0c-4a93-bcfa-c52f05d28612): created successfully Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c08cf-3014-430f-af1c-cd33e8d1f9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Flow 'volume_create_manager' (ba5fff39-d26c-4f61-be81-40de26578ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:38 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e187fb3e-2e6e-4984-a49d-6c882d9033c7 tempest-VolumesGetTest-1059039115 None] Created volume successfully. Sep 01 01:44:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-0530ffd8-9b0c-4a93-bcfa-c52f05d28612-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Lock "cinder-0530ffd8-9b0c-4a93-bcfa-c52f05d28612-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-0530ffd8-9b0c-4a93-bcfa-c52f05d28612" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-0530ffd8-9b0c-4a93-bcfa-c52f05d28612" acquired by "delete_volume" :: waited 0.060s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:40 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d3d59-e5de-429f-ab2a-7cac9aebc3fe]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:40 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 Sep 01 01:44:40 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:40 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612" returned: 0 in 0.745s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:40 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612 Sep 01 01:44:40 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:41 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0530ffd8-9b0c-4a93-bcfa-c52f05d28612" returned: 0 in 0.407s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-0530ffd8-9b0c-4a93-bcfa-c52f05d28612" released by "delete_volume" :: held 1.237s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Created reservations ['ce53f127-156a-4424-9c32-13786cabadcd', 'cdcc3e31-e7f9-4a33-8086-32ec72d35cf3', 'bf2bcceb-5a5c-4da8-b361-0b6ad9b72a32', '9baf4369-a8ba-4942-a966-59eaae1dbc06'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:41 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:41 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:41 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Deleted volume successfully. Sep 01 01:44:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85393464-e45b-4a53-bd4c-ba5dc9496b1f tempest-VolumesGetTest-1059039115 None] Lock "cinder-0530ffd8-9b0c-4a93-bcfa-c52f05d28612-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-64dde8fc-da5b-4335-b639-85a96db77a81-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Lock "cinder-64dde8fc-da5b-4335-b639-85a96db77a81-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Acquiring lock "cinder-quobyte-64dde8fc-da5b-4335-b639-85a96db77a81" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-64dde8fc-da5b-4335-b639-85a96db77a81" acquired by "delete_volume" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b626c-d324-4487-b4a4-02f4a258494d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:42 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 Sep 01 01:44:42 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:43 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81" returned: 0 in 0.599s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:43 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81 Sep 01 01:44:43 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:43 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-64dde8fc-da5b-4335-b639-85a96db77a81" returned: 0 in 0.392s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Lock "cinder-quobyte-64dde8fc-da5b-4335-b639-85a96db77a81" released by "delete_volume" :: held 1.063s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Created reservations ['88507c9f-2702-4b65-9110-224738c27209', '68aa736a-a46e-49ee-aa8e-66c75fa66f85', 'e37cd25b-cae2-4868-87e3-b457e9c350b3', 'cfdc4b90-0c6f-4abe-b75a-f558b82f911d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:43 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:43 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:44 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.523s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:44 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Deleted volume successfully. Sep 01 01:44:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c6a7c799-63c0-4ddf-ad37-5a3a33f1e445 tempest-VolumesGetTest-1059039115 None] Lock "cinder-64dde8fc-da5b-4335-b639-85a96db77a81-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:44 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Flow 'volume_create_manager' (907e047f-ef5b-4077-bdc7-61bed94a05e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aadb22-0faf-4d98-851c-8ae5cb5b5925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8aadb22-0faf-4d98-851c-8ae5cb5b5925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1342350628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f66b22e-0ff1-453d-a495-228c51f69628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae3d857ee9b47ffa882230e8b0738f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:45Z,use_quota=True,user_id='af94ce694f31403fbb12cf71a4006428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1787d9d-c6db-40d2-b9f6-f849b542aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1787d9d-c6db-40d2-b9f6-f849b542aa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7d9ad3-d481-43dd-b297-88bb23d10f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7d9ad3-d481-43dd-b297-88bb23d10f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f66b22e-0ff1-453d-a495-228c51f69628', 'volume_name': 'volume-7f66b22e-0ff1-453d-a495-228c51f69628', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c639f495-f232-4d64-8939-081fbbee42aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c639f495-f232-4d64-8939-081fbbee42aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa8da68-d4f6-469f-8908-988a0fbf5e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:45 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Volume 7f66b22e-0ff1-453d-a495-228c51f69628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f66b22e-0ff1-453d-a495-228c51f69628', 'volume_size': 1} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1342350628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f66b22e-0ff1-453d-a495-228c51f69628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aae3d857ee9b47ffa882230e8b0738f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:45Z,use_quota=True,user_id='af94ce694f31403fbb12cf71a4006428',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Creating volume 7f66b22e-0ff1-453d-a495-228c51f69628 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:45 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:45 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 1073741824 Sep 01 01:44:45 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:45 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 1073741824" returned: 0 in 0.762s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:45 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 Sep 01 01:44:45 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:46 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628" returned: 0 in 0.349s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa8da68-d4f6-469f-8908-988a0fbf5e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f66b22e-0ff1-453d-a495-228c51f69628', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828a0d3b-b7b7-468b-ac4f-3033cbc7dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:46 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Volume volume-7f66b22e-0ff1-453d-a495-228c51f69628 (7f66b22e-0ff1-453d-a495-228c51f69628): created successfully Sep 01 01:44:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828a0d3b-b7b7-468b-ac4f-3033cbc7dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Flow 'volume_create_manager' (907e047f-ef5b-4077-bdc7-61bed94a05e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:46 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-37f82e64-6463-4cc2-9049-596e5a36f7a3 tempest-TestMinimumBasicScenario-858552519 None] Created volume successfully. Sep 01 01:44:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-2cd28924-9979-4a9d-a60f-4831d2743848 req-c29f1116-ef63-4137-97c9-467da60041e2 tempest-TestMinimumBasicScenario-858552519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-2cd28924-9979-4a9d-a60f-4831d2743848 req-c29f1116-ef63-4137-97c9-467da60041e2 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-2cd28924-9979-4a9d-a60f-4831d2743848 req-c29f1116-ef63-4137-97c9-467da60041e2 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-2cd28924-9979-4a9d-a60f-4831d2743848 req-c29f1116-ef63-4137-97c9-467da60041e2 tempest-TestMinimumBasicScenario-858552519 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-7f66b22e-0ff1-453d-a495-228c51f69628', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62d5b9bb-a704-4100-8f11-f68a9927c0f4', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:44:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-2cd28924-9979-4a9d-a60f-4831d2743848 req-c29f1116-ef63-4137-97c9-467da60041e2 tempest-TestMinimumBasicScenario-858552519 None] attachment_update completed successfully. Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=122,cinder:SELECT=97,cinder:INSERT=37,cinder:DELETE=9 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=107,cinder:UPDATE=127,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Flow 'volume_create_manager' (76de624e-f6c2-474e-a976-b22223167fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1ea369-e533-4e2b-98eb-8b07d199514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1ea369-e533-4e2b-98eb-8b07d199514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1192374165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2945d83d-264a-431f-a816-f1e7ea01dad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f43b3404cc94b37960c91b9fb6816e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:51Z,use_quota=True,user_id='ef60f5015e584b079fe3094483fe93b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2784df7-f721-4f04-83aa-979135c67d78),volume_type_id=f2784df7-f721-4f04-83aa-979135c67d78)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be94f4fa-9489-4dcd-a964-4c1bdaf541bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be94f4fa-9489-4dcd-a964-4c1bdaf541bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26830fe-ee8c-4584-b551-d77132c874e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26830fe-ee8c-4584-b551-d77132c874e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2945d83d-264a-431f-a816-f1e7ea01dad4', 'volume_name': 'volume-2945d83d-264a-431f-a816-f1e7ea01dad4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de55fec1-6b05-4b93-9ced-90f223c3e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de55fec1-6b05-4b93-9ced-90f223c3e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33825e03-d902-463d-8279-9086d158cc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Volume 2945d83d-264a-431f-a816-f1e7ea01dad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2945d83d-264a-431f-a816-f1e7ea01dad4', 'volume_size': 1} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1192374165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2945d83d-264a-431f-a816-f1e7ea01dad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f43b3404cc94b37960c91b9fb6816e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:51Z,use_quota=True,user_id='ef60f5015e584b079fe3094483fe93b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2784df7-f721-4f04-83aa-979135c67d78),volume_type_id=f2784df7-f721-4f04-83aa-979135c67d78)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Creating volume 2945d83d-264a-431f-a816-f1e7ea01dad4 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:51 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:51 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 1073741824 Sep 01 01:44:51 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Flow 'volume_create_manager' (65f58aab-291e-4c1c-a93d-9e51aa19620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c36af68-9607-49ea-983e-b4774eff89e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c36af68-9607-49ea-983e-b4774eff89e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-134426667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33ddabf3fd1d45fba6afc379ab557860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:51Z,use_quota=True,user_id='272e64d1d28c4c719deecb0f47bf1a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160ada46-969f-4d58-85b6-9658bd92b036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160ada46-969f-4d58-85b6-9658bd92b036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97313abb-4482-4f05-8ba1-ffc63296b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97313abb-4482-4f05-8ba1-ffc63296b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c', 'volume_name': 'volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9871a1f-fa13-4069-bdfa-401192957c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9871a1f-fa13-4069-bdfa-401192957c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe656a72-e0b7-4294-9f4f-f8342f94eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Volume 811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c', 'volume_size': 1} Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:51 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 1073741824" returned: 0 in 0.625s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:52 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 Sep 01 01:44:52 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:52 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4" returned: 0 in 0.363s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-134426667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33ddabf3fd1d45fba6afc379ab557860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:51Z,use_quota=True,user_id='272e64d1d28c4c719deecb0f47bf1a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Creating volume 811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:52 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33825e03-d902-463d-8279-9086d158cc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2945d83d-264a-431f-a816-f1e7ea01dad4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:52 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c 1073741824 Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800425c-10f7-49f1-93c5-19ef0cca1845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:52 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Volume volume-2945d83d-264a-431f-a816-f1e7ea01dad4 (2945d83d-264a-431f-a816-f1e7ea01dad4): created successfully Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2800425c-10f7-49f1-93c5-19ef0cca1845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Flow 'volume_create_manager' (76de624e-f6c2-474e-a976-b22223167fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:52 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a911193e-559f-43ea-b825-16c315f9fbdb tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Created volume successfully. Sep 01 01:44:53 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c 1073741824" returned: 0 in 0.902s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:53 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c Sep 01 01:44:53 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:53 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe656a72-e0b7-4294-9f4f-f8342f94eed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953b4856-7825-47dd-a101-a1c94c646272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:53 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:53 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:53 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Volume volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c (811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c): created successfully Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953b4856-7825-47dd-a101-a1c94c646272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Flow 'volume_create_manager' (65f58aab-291e-4c1c-a93d-9e51aa19620c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-802e62aa-91b9-402a-a69b-b41c9d44f04b tempest-VolumesListTestJSON-1467650861 None] Created volume successfully. Sep 01 01:44:54 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.365s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:54 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:54 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ecd98a54-fdb9-4430-8f98-0bae45135ee6 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Retype volume completed successfully. Sep 01 01:44:54 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Flow 'volume_create_manager' (0ed8fc1a-f8ed-4b15-913a-a5ebd9441d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf74bea-7b6a-4cfd-b23c-990ca9858bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf74bea-7b6a-4cfd-b23c-990ca9858bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1298907040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1053d9c-c332-4652-9734-2c6aa1cdd4b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33ddabf3fd1d45fba6afc379ab557860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:55Z,use_quota=True,user_id='272e64d1d28c4c719deecb0f47bf1a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f6bd76-7780-4cb3-923b-8b9bbf3850cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f6bd76-7780-4cb3-923b-8b9bbf3850cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7e55c5-32b3-4dd3-99cf-84484f79f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7e55c5-32b3-4dd3-99cf-84484f79f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1053d9c-c332-4652-9734-2c6aa1cdd4b5', 'volume_name': 'volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea778f6-22fe-43c5-8a0a-3c097ec30b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea778f6-22fe-43c5-8a0a-3c097ec30b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c36f9b9-0587-4f60-912c-3e18b38a4fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:55 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Volume a1053d9c-c332-4652-9734-2c6aa1cdd4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5', 'volume_size': 1} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1298907040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1053d9c-c332-4652-9734-2c6aa1cdd4b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33ddabf3fd1d45fba6afc379ab557860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:55Z,use_quota=True,user_id='272e64d1d28c4c719deecb0f47bf1a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Creating volume a1053d9c-c332-4652-9734-2c6aa1cdd4b5 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:55 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:55 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 1073741824 Sep 01 01:44:55 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Acquiring lock "cinder-2945d83d-264a-431f-a816-f1e7ea01dad4-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "cinder-2945d83d-264a-431f-a816-f1e7ea01dad4-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Acquiring lock "cinder-quobyte-2945d83d-264a-431f-a816-f1e7ea01dad4" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "cinder-quobyte-2945d83d-264a-431f-a816-f1e7ea01dad4" acquired by "delete_volume" :: waited 0.040s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aae352-97f6-4fc6-b52d-b53769b77fa0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:55 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 Sep 01 01:44:55 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:55 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 1073741824" returned: 0 in 0.806s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:55 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 Sep 01 01:44:55 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:56 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4" returned: 0 in 0.595s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:56 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4 Sep 01 01:44:56 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:56 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5" returned: 0 in 0.335s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c36f9b9-0587-4f60-912c-3e18b38a4fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8663ec1a-0531-4191-9d62-abc93c0903ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Volume volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 (a1053d9c-c332-4652-9734-2c6aa1cdd4b5): created successfully Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8663ec1a-0531-4191-9d62-abc93c0903ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Flow 'volume_create_manager' (0ed8fc1a-f8ed-4b15-913a-a5ebd9441d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b9bd2d10-e68a-4d1f-95bf-92dd04681011 tempest-VolumesListTestJSON-1467650861 None] Created volume successfully. Sep 01 01:44:56 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2945d83d-264a-431f-a816-f1e7ea01dad4" returned: 0 in 0.354s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "cinder-quobyte-2945d83d-264a-431f-a816-f1e7ea01dad4" released by "delete_volume" :: held 1.013s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:56 devstack cinder-volume[87212]: WARNING cinder.quota [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:44:56 devstack cinder-volume[87212]: WARNING cinder.quota [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Created reservations ['62d505bc-b2e5-4f9b-b8ae-06abb1943428', '16ea7a3a-a5ae-4381-9524-bae493e979ad', 'cac1fbc5-b53b-4715-b3ad-1becf5acc0dc', '5ca21b52-7d86-44f5-9293-e50349e27c8a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:56 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:44:56 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:56 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.283s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:44:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Deleted volume successfully. Sep 01 01:44:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f7b34def-0781-45c1-9727-708d2a06c190 tempest-VolumeRetypeWithoutMigrationTest-907351865 None] Lock "cinder-2945d83d-264a-431f-a816-f1e7ea01dad4-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Flow 'volume_create_manager' (e6d08c3a-fd2c-4607-9941-d37c4aa0314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d615f-269f-439d-a5ed-e5f0c2a9c833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164d615f-269f-439d-a5ed-e5f0c2a9c833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-358963594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e2b793-fdde-481c-896b-9268aed900bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33ddabf3fd1d45fba6afc379ab557860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:57Z,use_quota=True,user_id='272e64d1d28c4c719deecb0f47bf1a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef7dab8-11cc-4e0a-9568-cf20f6f14a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef7dab8-11cc-4e0a-9568-cf20f6f14a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4ad613-5a30-4ad3-9dfc-0422b4cf76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4ad613-5a30-4ad3-9dfc-0422b4cf76a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e2b793-fdde-481c-896b-9268aed900bc', 'volume_name': 'volume-35e2b793-fdde-481c-896b-9268aed900bc', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042fbdb9-6718-4167-9c79-3db8544a74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042fbdb9-6718-4167-9c79-3db8544a74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be290340-ce15-4f30-992e-2b0555e3d14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:57 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Volume 35e2b793-fdde-481c-896b-9268aed900bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e2b793-fdde-481c-896b-9268aed900bc', 'volume_size': 1} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-358963594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e2b793-fdde-481c-896b-9268aed900bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33ddabf3fd1d45fba6afc379ab557860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:44:57Z,use_quota=True,user_id='272e64d1d28c4c719deecb0f47bf1a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Creating volume 35e2b793-fdde-481c-896b-9268aed900bc {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:44:57 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:44:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:57 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc 1073741824 Sep 01 01:44:57 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:58 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc 1073741824" returned: 0 in 0.627s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:44:58 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc Sep 01 01:44:58 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:44:58 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 01 01:44:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc" returned: 0 in 0.564s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:44:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:44:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:44:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be290340-ce15-4f30-992e-2b0555e3d14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e2b793-fdde-481c-896b-9268aed900bc', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b177b244-4857-41fd-929e-3b5f4bd5a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:44:59 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Volume volume-35e2b793-fdde-481c-896b-9268aed900bc (35e2b793-fdde-481c-896b-9268aed900bc): created successfully Sep 01 01:44:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b177b244-4857-41fd-929e-3b5f4bd5a104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:44:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Flow 'volume_create_manager' (e6d08c3a-fd2c-4607-9941-d37c4aa0314f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:44:59 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-444b0659-6ed3-4a3e-b6e0-2af403737e37 tempest-VolumesListTestJSON-1467650861 None] Created volume successfully. Sep 01 01:45:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "cinder-35e2b793-fdde-481c-896b-9268aed900bc-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-35e2b793-fdde-481c-896b-9268aed900bc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "cinder-quobyte-35e2b793-fdde-481c-896b-9268aed900bc" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-quobyte-35e2b793-fdde-481c-896b-9268aed900bc" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:03 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d70de4a-da4d-497f-909d-83a01c6ff29b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:04 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc Sep 01 01:45:04 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:04 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc" returned: 0 in 0.480s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:04 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc Sep 01 01:45:04 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:04 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-35e2b793-fdde-481c-896b-9268aed900bc" returned: 0 in 0.298s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-quobyte-35e2b793-fdde-481c-896b-9268aed900bc" released by "delete_volume" :: held 0.842s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:04 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Created reservations ['b34e6d14-c48c-48d5-81ec-6439c6c33266', '450d2e7d-e59a-4863-aae5-dc218c30c04b', 'b1f3497d-2276-4dbf-856b-cc93aa86acd8', '55a8d46e-ac26-4364-b887-8142e9c9d63d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:05 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:45:05 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:05 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:45:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Deleted volume successfully. Sep 01 01:45:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3cf9f69-3a9e-46af-91c4-cef5a7179a9f tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-35e2b793-fdde-481c-896b-9268aed900bc-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "cinder-a1053d9c-c332-4652-9734-2c6aa1cdd4b5-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-a1053d9c-c332-4652-9734-2c6aa1cdd4b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "cinder-quobyte-a1053d9c-c332-4652-9734-2c6aa1cdd4b5" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-quobyte-a1053d9c-c332-4652-9734-2c6aa1cdd4b5" acquired by "delete_volume" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1824714-a9e7-47e7-9070-6526310d1449]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:06 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 Sep 01 01:45:06 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:06 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5" returned: 0 in 0.534s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:06 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5 Sep 01 01:45:06 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:07 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1053d9c-c332-4652-9734-2c6aa1cdd4b5" returned: 0 in 0.326s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-quobyte-a1053d9c-c332-4652-9734-2c6aa1cdd4b5" released by "delete_volume" :: held 0.946s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Created reservations ['79bba336-ef2c-4728-be66-5c67b36d7b4b', 'c536f505-b3d3-4aab-8d8c-cd222a4cfcc9', '8a27d778-68f2-4cac-8c0d-b40ba7d5fce0', 'f3544261-f36c-4e5d-ac7a-ce4c50928bcf'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:07 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:45:07 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:07 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.253s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:45:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Deleted volume successfully. Sep 01 01:45:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3449a511-340c-4da5-9121-1fb9014833ad tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-a1053d9c-c332-4652-9734-2c6aa1cdd4b5-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Flow 'volume_create_manager' (712f5042-bede-43a8-a421-bec77c1557bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16466641-6f19-4771-aea1-bf14571d2002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16466641-6f19-4771-aea1-bf14571d2002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1248754080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042dffd0-14a4-40f4-9748-46fb21d157f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef7e2ac2fc14c458c3baa2883b3e526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:45:08Z,use_quota=True,user_id='455301fddb4843b1bd7d39f32d131a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7b3448-05c6-4f23-a120-26e1d38d0ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7b3448-05c6-4f23-a120-26e1d38d0ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d776dbd1-fc82-40ef-8ee3-ab1736c44d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d776dbd1-fc82-40ef-8ee3-ab1736c44d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042dffd0-14a4-40f4-9748-46fb21d157f3', 'volume_name': 'volume-042dffd0-14a4-40f4-9748-46fb21d157f3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca01bd8-3bfb-4cd7-bec8-39eb5b800480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca01bd8-3bfb-4cd7-bec8-39eb5b800480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2675e63-1403-4308-a4f4-c0608cb072a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:08 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Volume 042dffd0-14a4-40f4-9748-46fb21d157f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042dffd0-14a4-40f4-9748-46fb21d157f3', 'volume_size': 1} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1248754080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042dffd0-14a4-40f4-9748-46fb21d157f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cef7e2ac2fc14c458c3baa2883b3e526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:45:08Z,use_quota=True,user_id='455301fddb4843b1bd7d39f32d131a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Creating volume 042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:45:08 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:08 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 1073741824 Sep 01 01:45:08 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:08 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 1073741824" returned: 0 in 0.489s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:08 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 Sep 01 01:45:08 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "cinder-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "cinder-quobyte-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-quobyte-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b3e36b-c5e2-4d0f-8427-b022f01f4bcd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:08 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3" returned: 0 in 0.268s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2675e63-1403-4308-a4f4-c0608cb072a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042dffd0-14a4-40f4-9748-46fb21d157f3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1e7745-28dc-4d54-96cb-4f6bd50becc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:08 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Volume volume-042dffd0-14a4-40f4-9748-46fb21d157f3 (042dffd0-14a4-40f4-9748-46fb21d157f3): created successfully Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1e7745-28dc-4d54-96cb-4f6bd50becc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Flow 'volume_create_manager' (712f5042-bede-43a8-a421-bec77c1557bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:45:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a785e2be-44ca-4ae3-be42-46f38b845f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Created volume successfully. Sep 01 01:45:09 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c Sep 01 01:45:09 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:09 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:09 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c Sep 01 01:45:09 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:09 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-quobyte-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c" released by "delete_volume" :: held 0.713s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Created reservations ['46bb0ddf-e923-48bd-ad7a-103024a8f7df', '1a6fc01d-a7df-440a-b40b-8eca301ce676', '9127c61f-1fe3-430e-863e-884f59c3f21c', '2f83f4e5-3b75-4dcf-ae2d-5012dd21a3f0'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:09 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:45:09 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:10 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:45:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Deleted volume successfully. Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e831a6a-7051-444c-a559-61fe9ed88775 tempest-VolumesListTestJSON-1467650861 None] Lock "cinder-811e0e1e-1ea9-43b4-9c5f-871f0ccd2a6c-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Creating offline snapshot 715389ed-731d-473d-aded-7adeacd3c741 of volume 042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6b5a2-bfef-4ef5-b8fe-78f77caf7e52]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:10 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 Sep 01 01:45:10 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:11 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3" returned: 0 in 0.558s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:11 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 1G Sep 01 01:45:11 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:11 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 1G" returned: 0 in 0.704s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042dffd0-14a4-40f4-9748-46fb21d157f3 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:11 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042dffd0-14a4-40f4-9748-46fb21d157f3 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 Sep 01 01:45:11 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:12 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-042dffd0-14a4-40f4-9748-46fb21d157f3 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741" returned: 0 in 0.436s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:12 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 is being set with open permissions: ugo+rw Sep 01 01:45:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:12 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 Sep 01 01:45:12 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:12 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741" returned: 0 in 0.331s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:12 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.info Sep 01 01:45:12 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:13 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.info" returned: 0 in 0.455s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:13 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.info is being set with open permissions: ugo+rw Sep 01 01:45:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:13 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.info Sep 01 01:45:13 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:13 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.info" returned: 0 in 0.286s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:13 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-009e5c77-151b-406b-94bf-9c040922a337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Create snapshot completed successfully Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "cinder-715389ed-731d-473d-aded-7adeacd3c741-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-715389ed-731d-473d-aded-7adeacd3c741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "cinder-quobyte-042dffd0-14a4-40f4-9748-46fb21d157f3" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-quobyte-042dffd0-14a4-40f4-9748-46fb21d157f3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "cinder-quobyte-715389ed-731d-473d-aded-7adeacd3c741" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-quobyte-715389ed-731d-473d-aded-7adeacd3c741" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Deleting offline snapshot 715389ed-731d-473d-aded-7adeacd3c741 of volume 042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] snapshot_file for this snap is: volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Flow 'volume_create_manager' (88ef34cb-cdcd-44b3-97d0-6e27590a80f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6203ba6d-3555-4771-9dde-b2913e4e465e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0202230d-d3f3-40d3-8ea7-23e938325f8e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6203ba6d-3555-4771-9dde-b2913e4e465e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-326828004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be337c55-9ed7-4ccb-b0be-32b2209d48d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b11d12e22441a0b6cf03d343ee54af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:45:14Z,use_quota=True,user_id='ce4f79bbe3024527bac1d1e15ac9a45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3620764-5832-4990-81d7-ba7272f8820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3620764-5832-4990-81d7-ba7272f8820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d9f20d-287a-4735-990d-1cc54d4b36e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d9f20d-287a-4735-990d-1cc54d4b36e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be337c55-9ed7-4ccb-b0be-32b2209d48d2', 'volume_name': 'volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8b6dee-f9b0-4b6e-ab6a-230a3bb616fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8b6dee-f9b0-4b6e-ab6a-230a3bb616fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e13506a-d170-4957-83f8-d28b5ad02105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:14 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Volume be337c55-9ed7-4ccb-b0be-32b2209d48d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2', 'volume_size': 1} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-326828004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be337c55-9ed7-4ccb-b0be-32b2209d48d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b11d12e22441a0b6cf03d343ee54af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:45:14Z,use_quota=True,user_id='ce4f79bbe3024527bac1d1e15ac9a45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Creating volume be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:45:14 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:14 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 1073741824 Sep 01 01:45:14 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:14 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 Sep 01 01:45:14 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:14 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741" returned: 0 in 0.458s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-042dffd0-14a4-40f4-9748-46fb21d157f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f0a94-7d41-4f32-bb37-2105b5980132]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:15 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 Sep 01 01:45:15 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:15 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 1073741824" returned: 0 in 0.560s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:15 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 Sep 01 01:45:15 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:15 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3" returned: 0 in 0.466s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:15 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2" returned: 0 in 0.292s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:15 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 Sep 01 01:45:15 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e13506a-d170-4957-83f8-d28b5ad02105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b75e8f-bd44-482f-999c-de0c5cad080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:15 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Volume volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 (be337c55-9ed7-4ccb-b0be-32b2209d48d2): created successfully Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b75e8f-bd44-482f-999c-de0c5cad080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Flow 'volume_create_manager' (88ef34cb-cdcd-44b3-97d0-6e27590a80f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:45:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d364c290-1a3d-4c58-9c03-c9c6fb1e3102 tempest-VolumesSnapshotListTestJSON-957354258 None] Created volume successfully. Sep 01 01:45:15 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741" returned: 0 in 0.348s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:15 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741 Sep 01 01:45:15 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:16 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3.715389ed-731d-473d-aded-7adeacd3c741" returned: 0 in 0.247s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-quobyte-715389ed-731d-473d-aded-7adeacd3c741" released by "_delete_snapshot" :: held 1.686s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-quobyte-042dffd0-14a4-40f4-9748-46fb21d157f3" released by "delete_snapshot" :: held 1.721s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Created reservations ['43df41bb-ab47-4961-928f-9715142be75d', '8497709f-732a-4a56-b4f8-e1b15e8a3c0e', '2f6f4fc5-0708-4ee1-818a-4ff2745081ee', 'a10f2216-95d7-4c31-89ba-f796a629a515'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Delete snapshot completed successfully. Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-97d7c786-d0a6-46db-833e-1bb4f848b21f tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-715389ed-731d-473d-aded-7adeacd3c741-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "cinder-042dffd0-14a4-40f4-9748-46fb21d157f3-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-042dffd0-14a4-40f4-9748-46fb21d157f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "cinder-quobyte-042dffd0-14a4-40f4-9748-46fb21d157f3" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-quobyte-042dffd0-14a4-40f4-9748-46fb21d157f3" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Creating offline snapshot f3b52240-89ea-4e96-9173-226ddc3c1a95 of volume be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ec5c81-2b18-4956-84cf-d58d57b79c05]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f67120-ed17-45df-a657-6397d623296f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:16 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 Sep 01 01:45:16 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:16 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 Sep 01 01:45:16 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:17 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:45:17 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:17 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2" returned: 0 in 0.383s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:17 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 1G Sep 01 01:45:17 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:17 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3" returned: 0 in 0.437s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:17 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3 Sep 01 01:45:17 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:17 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:45:17 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-042dffd0-14a4-40f4-9748-46fb21d157f3" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-quobyte-042dffd0-14a4-40f4-9748-46fb21d157f3" released by "delete_volume" :: held 0.785s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Created reservations ['a4aa46fd-f8a8-4c8e-9632-9a9479c96d88', 'fb03e8e1-7cf5-4719-9a53-cdcdac1cd983', 'dcbc653c-bce2-4cde-a840-49c7e29d1e12', 'dab9fb6c-771d-4ec1-9e2c-d8ea6aa0f84f'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:17 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 1G" returned: 0 in 0.505s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:17 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:45:17 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:17 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 Sep 01 01:45:17 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:18 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95" returned: 0 in 0.373s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:18 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 is being set with open permissions: ugo+rw Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:18 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.418s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:45:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Deleted volume successfully. Sep 01 01:45:18 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 Sep 01 01:45:18 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ab7d165-3cdf-4d0f-ae9a-4105f93a70fb tempest-VolumeSnapshotQuotasNegativeTestJSON-1162791851 None] Lock "cinder-042dffd0-14a4-40f4-9748-46fb21d157f3-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:18 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95" returned: 0 in 0.299s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:18 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.info Sep 01 01:45:18 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:18 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.info" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:18 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.info is being set with open permissions: ugo+rw Sep 01 01:45:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:18 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.info Sep 01 01:45:18 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:19 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.info" returned: 0 in 0.314s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:19 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-70584d3d-ae51-487c-b57c-e22f83f16c92 tempest-VolumesSnapshotListTestJSON-957354258 None] Create snapshot completed successfully Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Creating offline snapshot cf888e0c-dc4f-43cd-9a5a-484d8687e7de of volume be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ab719-f8e1-4518-8bf3-a5bb0ab428dd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:20 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 Sep 01 01:45:20 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:20 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95" returned: 0 in 0.473s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:20 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de 1G Sep 01 01:45:20 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:21 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de 1G" returned: 0 in 0.754s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:21 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de Sep 01 01:45:21 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:22 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de" returned: 0 in 0.469s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:22 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de is being set with open permissions: ugo+rw Sep 01 01:45:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:22 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de Sep 01 01:45:22 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:22 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de" returned: 0 in 0.348s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:22 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-59b3843f-878d-4a6f-a710-d7fab51dc25a tempest-VolumesSnapshotListTestJSON-957354258 None] Create snapshot completed successfully Sep 01 01:45:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Creating offline snapshot 380e75e9-a7a0-4baa-9d87-d6f89c391bee of volume be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:45:23 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f541a1-aaaa-4723-8c52-ea67ed32be8b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:23 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de Sep 01 01:45:23 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:24 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de" returned: 0 in 0.444s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:24 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee 1G Sep 01 01:45:24 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:24 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee 1G" returned: 0 in 0.689s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:24 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee Sep 01 01:45:24 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:25 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee" returned: 0 in 0.409s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:25 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee is being set with open permissions: ugo+rw Sep 01 01:45:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:25 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee Sep 01 01:45:25 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:25 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee" returned: 0 in 0.329s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7f59ec0a-0748-4859-9b3e-9006c4cc4e44 tempest-VolumesSnapshotListTestJSON-957354258 None] Create snapshot completed successfully Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Flow 'volume_create_manager' (bde8d14c-72b3-44e5-9c4d-4eccbe73fd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07a3ad5-7457-4eb0-b2cc-a1150d74ac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07a3ad5-7457-4eb0-b2cc-a1150d74ac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-678157518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b5720f-6389-4efd-8872-06bf327fef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50511ceba19749219a8f3f2092f7177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:45:26Z,use_quota=True,user_id='6fe3c2c1027c462bafc91e96186b52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b371901-05d5-487e-88a6-2240c1d0459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b371901-05d5-487e-88a6-2240c1d0459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885d4140-008b-4f7c-822e-16050585e2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885d4140-008b-4f7c-822e-16050585e2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b5720f-6389-4efd-8872-06bf327fef3e', 'volume_name': 'volume-08b5720f-6389-4efd-8872-06bf327fef3e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad66599-d8a7-495e-8c01-dc04cadb8dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad66599-d8a7-495e-8c01-dc04cadb8dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c44424-e380-400e-bb44-a906032f1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:26 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Volume 08b5720f-6389-4efd-8872-06bf327fef3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b5720f-6389-4efd-8872-06bf327fef3e', 'volume_size': 1} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-678157518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b5720f-6389-4efd-8872-06bf327fef3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50511ceba19749219a8f3f2092f7177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:45:26Z,use_quota=True,user_id='6fe3c2c1027c462bafc91e96186b52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Creating volume 08b5720f-6389-4efd-8872-06bf327fef3e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:45:26 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:26 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e 1073741824 Sep 01 01:45:26 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:26 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e 1073741824" returned: 0 in 0.554s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:26 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e Sep 01 01:45:26 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:27 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e" returned: 0 in 0.361s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-380e75e9-a7a0-4baa-9d87-d6f89c391bee-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c44424-e380-400e-bb44-a906032f1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b5720f-6389-4efd-8872-06bf327fef3e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a216345-bddd-4343-82c8-5f66d2975849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-380e75e9-a7a0-4baa-9d87-d6f89c391bee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:27 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Volume volume-08b5720f-6389-4efd-8872-06bf327fef3e (08b5720f-6389-4efd-8872-06bf327fef3e): created successfully Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a216345-bddd-4343-82c8-5f66d2975849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Flow 'volume_create_manager' (bde8d14c-72b3-44e5-9c4d-4eccbe73fd16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-quobyte-380e75e9-a7a0-4baa-9d87-d6f89c391bee" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-db5fcaf4-4ea4-4c9e-b52e-2555c1c9b68b tempest-AttachVolumeNegativeTest-753336702 None] Created volume successfully. Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-380e75e9-a7a0-4baa-9d87-d6f89c391bee" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Deleting offline snapshot 380e75e9-a7a0-4baa-9d87-d6f89c391bee of volume be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] snapshot_file for this snap is: volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1326fdab-96ea-4f5c-89d8-6e1503aea9ac]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:27 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee Sep 01 01:45:27 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:27 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3f8fd6-a335-4cf6-a62a-f50128903941]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:27 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de Sep 01 01:45:27 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:28 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de" returned: 0 in 0.448s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:28 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee Sep 01 01:45:28 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:28 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee" returned: 0 in 0.572s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:28 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee Sep 01 01:45:28 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:29 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.380e75e9-a7a0-4baa-9d87-d6f89c391bee" returned: 0 in 0.325s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-380e75e9-a7a0-4baa-9d87-d6f89c391bee" released by "_delete_snapshot" :: held 1.841s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" released by "delete_snapshot" :: held 1.875s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Created reservations ['2c99cf15-daf4-4b37-9f5c-f79459702a9c', 'f5dcf045-c6f0-4416-94b5-0f1b2e6c90c6', '78fe0586-5d02-45b7-bc40-3c403b12832b', 'fb65ee58-e209-46a4-a830-a26fcd865f26'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Delete snapshot completed successfully. Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a32ecfea-1015-43c1-8bf8-b80e869eb43b tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-380e75e9-a7a0-4baa-9d87-d6f89c391bee-delete_snapshot" released by "delete_snapshot" :: held 2.084s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-cf888e0c-dc4f-43cd-9a5a-484d8687e7de-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-ed5c3922-39e2-4e93-948c-17cff206df62 req-d6ad939f-79fb-4e37-a5fd-1aa0b5c17360 tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-ed5c3922-39e2-4e93-948c-17cff206df62 req-d6ad939f-79fb-4e37-a5fd-1aa0b5c17360 tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-cf888e0c-dc4f-43cd-9a5a-484d8687e7de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-ed5c3922-39e2-4e93-948c-17cff206df62 req-d6ad939f-79fb-4e37-a5fd-1aa0b5c17360 tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-quobyte-cf888e0c-dc4f-43cd-9a5a-484d8687e7de" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-cf888e0c-dc4f-43cd-9a5a-484d8687e7de" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Deleting offline snapshot cf888e0c-dc4f-43cd-9a5a-484d8687e7de of volume be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] snapshot_file for this snap is: volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-ed5c3922-39e2-4e93-948c-17cff206df62 req-d6ad939f-79fb-4e37-a5fd-1aa0b5c17360 tempest-AttachVolumeNegativeTest-753336702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-08b5720f-6389-4efd-8872-06bf327fef3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7bd4873-13f2-4d8f-9608-2dc060bcdcb7', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa740cfe-0597-4b39-9988-e9a12a1f227b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-ed5c3922-39e2-4e93-948c-17cff206df62 req-d6ad939f-79fb-4e37-a5fd-1aa0b5c17360 tempest-AttachVolumeNegativeTest-753336702 None] attachment_update completed successfully. Sep 01 01:45:29 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de Sep 01 01:45:29 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:29 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de" returned: 0 in 0.449s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3995c772-adeb-444f-9a54-7d959268c723]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:30 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 Sep 01 01:45:30 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:30 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95" returned: 0 in 0.470s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:30 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de Sep 01 01:45:30 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:30 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de" returned: 0 in 0.473s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:30 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de Sep 01 01:45:30 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:31 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.cf888e0c-dc4f-43cd-9a5a-484d8687e7de" returned: 0 in 0.341s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-cf888e0c-dc4f-43cd-9a5a-484d8687e7de" released by "_delete_snapshot" :: held 1.859s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" released by "delete_snapshot" :: held 1.886s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Created reservations ['c0036625-5283-48d9-8994-81af30490eeb', '4f96325f-3c67-4069-b8c2-389004c8aef5', '55739e49-018d-449e-98aa-15186e319185', 'c654e5c4-5bb2-4ed8-b9e2-74e28b4aab0b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Delete snapshot completed successfully. Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7e82c1c6-6d84-403c-8e27-08115d3b2b59 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-cf888e0c-dc4f-43cd-9a5a-484d8687e7de-delete_snapshot" released by "delete_snapshot" :: held 2.076s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-f3b52240-89ea-4e96-9173-226ddc3c1a95-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-f3b52240-89ea-4e96-9173-226ddc3c1a95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-quobyte-f3b52240-89ea-4e96-9173-226ddc3c1a95" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-f3b52240-89ea-4e96-9173-226ddc3c1a95" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Deleting offline snapshot f3b52240-89ea-4e96-9173-226ddc3c1a95 of volume be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] snapshot_file for this snap is: volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c3e6d2-aa77-4f64-a6c1-0974c86f0a1b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:31 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 Sep 01 01:45:31 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:31 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95" returned: 0 in 0.385s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:45:32 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[17555966-90dc-49d9-b924-7834bdcb7b06]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:32 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 Sep 01 01:45:32 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:32 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2" returned: 0 in 0.438s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:32 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 Sep 01 01:45:32 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:32 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95" returned: 0 in 0.479s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:32 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95 Sep 01 01:45:32 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:33 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2.f3b52240-89ea-4e96-9173-226ddc3c1a95" returned: 0 in 0.386s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-f3b52240-89ea-4e96-9173-226ddc3c1a95" released by "_delete_snapshot" :: held 1.844s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" released by "delete_snapshot" :: held 1.874s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Created reservations ['61b47b16-3008-4881-abf1-389647ed45c2', '40f24a76-b507-487c-a2a5-92b1392f8080', '96a27ae9-542b-43fa-a3f0-672fe33abd56', '64e2d823-d272-48a0-b563-bc719f1d267a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Delete snapshot completed successfully. Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-343e9097-7622-4f39-9f70-b8c28ec18a92 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-f3b52240-89ea-4e96-9173-226ddc3c1a95-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-be337c55-9ed7-4ccb-b0be-32b2209d48d2-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-be337c55-9ed7-4ccb-b0be-32b2209d48d2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[06801d9e-51f6-48dc-8417-fe24a9b5b808]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:34 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 Sep 01 01:45:34 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:34 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2" returned: 0 in 0.473s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:34 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2 Sep 01 01:45:34 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:34 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-be337c55-9ed7-4ccb-b0be-32b2209d48d2" returned: 0 in 0.289s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-quobyte-be337c55-9ed7-4ccb-b0be-32b2209d48d2" released by "delete_volume" :: held 0.839s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Created reservations ['807d4a93-c7f3-451e-a79b-8caf34459821', '4fdb8c6e-57ad-48ce-bf97-c0fecdb78cab', 'e0ac394a-d061-4a63-98cf-b5e4aeb85eb5', 'cebaa767-43da-42cd-a6c4-c10d7ebccd31'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:34 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:45:34 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:35 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.359s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:35 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:45:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Deleted volume successfully. Sep 01 01:45:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-061fc774-5a0d-4e58-935d-8e806552f917 tempest-VolumesSnapshotListTestJSON-957354258 None] Lock "cinder-be337c55-9ed7-4ccb-b0be-32b2209d48d2-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-f84ee9ec-f3b4-4c6c-a7c9-4dc2c0795b2e req-7f0cda9c-2400-4e68-92df-45fb75d45462 tempest-TestMinimumBasicScenario-858552519 None] Terminate volume connection completed successfully. Sep 01 01:45:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-f84ee9ec-f3b4-4c6c-a7c9-4dc2c0795b2e req-7f0cda9c-2400-4e68-92df-45fb75d45462 tempest-TestMinimumBasicScenario-858552519 None] Deleting attachment 62d5b9bb-a704-4100-8f11-f68a9927c0f4. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Acquiring lock "cinder-7f66b22e-0ff1-453d-a495-228c51f69628-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Lock "cinder-7f66b22e-0ff1-453d-a495-228c51f69628-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Acquiring lock "cinder-quobyte-7f66b22e-0ff1-453d-a495-228c51f69628" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Lock "cinder-quobyte-7f66b22e-0ff1-453d-a495-228c51f69628" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[992340e4-e6ea-47ab-b1c0-f9c518d9fc13]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:40 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 Sep 01 01:45:40 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:40 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628" returned: 0 in 0.423s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:40 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628 Sep 01 01:45:40 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:41 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7f66b22e-0ff1-453d-a495-228c51f69628" returned: 0 in 0.321s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Lock "cinder-quobyte-7f66b22e-0ff1-453d-a495-228c51f69628" released by "delete_volume" :: held 0.809s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Created reservations ['146a69bf-5a08-440c-b429-8ae86f53baca', '1abb1d87-b2cc-4cc0-9208-d368c2a55573', '17dcc422-9f09-41f5-b4d8-6ad0b23e06b3', 'c57576a7-803f-481d-85dc-dd2b09cf05d6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:45:41 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:45:41 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:45:41 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.316s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:45:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Deleted volume successfully. Sep 01 01:45:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-76da0cb2-f800-4d1c-8213-bf434f505533 tempest-TestMinimumBasicScenario-858552519 None] Lock "cinder-7f66b22e-0ff1-453d-a495-228c51f69628-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:45:51 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=98,cinder:UPDATE=114,cinder:DELETE=11,cinder:INSERT=30 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:45:51 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=92,cinder:UPDATE=105,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Flow 'volume_create_manager' (b9a7b434-8410-471d-8639-298bfd4421bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcd684a-dd36-4485-933e-4a10fbc49ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcd684a-dd36-4485-933e-4a10fbc49ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-436954674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf33353-8dc0-4190-9e75-ff9b0cf34a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84fe3c5244e4de99df80430d3ce85f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:15Z,use_quota=True,user_id='796d9c705a6a45e1906eb85244713e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87666dd5-c20a-45b4-9dbc-f7ec8095723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87666dd5-c20a-45b4-9dbc-f7ec8095723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ddfd8-0d39-43b6-adfc-41c3de2bce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ddfd8-0d39-43b6-adfc-41c3de2bce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf33353-8dc0-4190-9e75-ff9b0cf34a81', 'volume_name': 'volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feacc1b-d16a-4f67-93a9-8c41ad2dcc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feacc1b-d16a-4f67-93a9-8c41ad2dcc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7434c68c-8851-41a1-a4e4-29f35375178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:14 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Volume ddf33353-8dc0-4190-9e75-ff9b0cf34a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81', 'volume_size': 1} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-436954674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf33353-8dc0-4190-9e75-ff9b0cf34a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84fe3c5244e4de99df80430d3ce85f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:15Z,use_quota=True,user_id='796d9c705a6a45e1906eb85244713e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Creating volume ddf33353-8dc0-4190-9e75-ff9b0cf34a81 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:46:14 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:46:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:14 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 1073741824 Sep 01 01:46:14 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Flow 'volume_create_manager' (9fee814f-21a4-4d33-955d-ab7e49bef6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d119220-ae72-4b21-bfd5-5d149d09f0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d119220-ae72-4b21-bfd5-5d149d09f0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1641696873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc4063a-8602-4e9d-a016-c8b7caa08280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84fe3c5244e4de99df80430d3ce85f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:15Z,use_quota=True,user_id='796d9c705a6a45e1906eb85244713e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6168db98-06d9-4c0d-8809-77b6ee948f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6168db98-06d9-4c0d-8809-77b6ee948f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759bade-073d-4509-ab9d-11590092e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5759bade-073d-4509-ab9d-11590092e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc4063a-8602-4e9d-a016-c8b7caa08280', 'volume_name': 'volume-bbc4063a-8602-4e9d-a016-c8b7caa08280', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e007349-379e-470a-b711-5e0cad1940e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e007349-379e-470a-b711-5e0cad1940e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f28e10-c5db-4e67-8f42-854d4fa3fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:15 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Volume bbc4063a-8602-4e9d-a016-c8b7caa08280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc4063a-8602-4e9d-a016-c8b7caa08280', 'volume_size': 1} Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:15 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 1073741824" returned: 0 in 1.019s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:16 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 Sep 01 01:46:16 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:16 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81" returned: 0 in 0.514s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1641696873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc4063a-8602-4e9d-a016-c8b7caa08280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84fe3c5244e4de99df80430d3ce85f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:15Z,use_quota=True,user_id='796d9c705a6a45e1906eb85244713e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Creating volume bbc4063a-8602-4e9d-a016-c8b7caa08280 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:46:16 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:16 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 1073741824 Sep 01 01:46:16 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7434c68c-8851-41a1-a4e4-29f35375178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92facf5-1311-4d02-8d6d-a77f9183bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Volume volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 (ddf33353-8dc0-4190-9e75-ff9b0cf34a81): created successfully Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92facf5-1311-4d02-8d6d-a77f9183bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Flow 'volume_create_manager' (b9a7b434-8410-471d-8639-298bfd4421bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-74d654b7-3da3-4f8d-9acd-c4f2483b0c52 tempest-TestServerVolumeAttachmentScenario-3325454 None] Created volume successfully. Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:17 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:46:17 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:17 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 1073741824" returned: 0 in 1.063s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:17 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 Sep 01 01:46:17 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:17 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.694s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:46:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:46:18 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280" returned: 0 in 0.495s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:46:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f28e10-c5db-4e67-8f42-854d4fa3fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc4063a-8602-4e9d-a016-c8b7caa08280', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558ba261-479e-44d1-a439-610f55ea03e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:18 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Volume volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 (bbc4063a-8602-4e9d-a016-c8b7caa08280): created successfully Sep 01 01:46:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558ba261-479e-44d1-a439-610f55ea03e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Flow 'volume_create_manager' (9fee814f-21a4-4d33-955d-ab7e49bef6ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bd2f0321-47c8-4331-b4a8-7e200c91875b tempest-TestServerVolumeAttachmentScenario-3325454 None] Created volume successfully. Sep 01 01:46:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-f082ba5e-e350-4a25-b2c9-a5a090c3d974 req-ced8507e-e279-4184-9e07-7f3d425014a1 tempest-AttachVolumeNegativeTest-753336702 None] Terminate volume connection completed successfully. Sep 01 01:46:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-f082ba5e-e350-4a25-b2c9-a5a090c3d974 req-ced8507e-e279-4184-9e07-7f3d425014a1 tempest-AttachVolumeNegativeTest-753336702 None] Deleting attachment d7bd4873-13f2-4d8f-9608-2dc060bcdcb7. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (5208a53d-378a-4898-8196-7281b70f463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace00b09-c6eb-4e71-9be8-a7251e67e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ace00b09-c6eb-4e71-9be8-a7251e67e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1476884226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f34749c-e2cd-4574-872a-cae661765261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:29Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7caf1ea-525f-4fb6-8862-0509e5c5583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7caf1ea-525f-4fb6-8862-0509e5c5583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eee53e4-ce95-49a2-8c70-b2b9f16f7cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eee53e4-ce95-49a2-8c70-b2b9f16f7cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f34749c-e2cd-4574-872a-cae661765261', 'volume_name': 'volume-9f34749c-e2cd-4574-872a-cae661765261', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cc9498-bc6c-44ed-aa02-3ad82bb07426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cc9498-bc6c-44ed-aa02-3ad82bb07426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7568766c-7c96-4970-8bbb-96910c115e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Volume 9f34749c-e2cd-4574-872a-cae661765261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f34749c-e2cd-4574-872a-cae661765261', 'volume_size': 1} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1476884226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f34749c-e2cd-4574-872a-cae661765261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:29Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Creating volume 9f34749c-e2cd-4574-872a-cae661765261 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:46:29 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:46:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:29 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 1073741824 Sep 01 01:46:29 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:30 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 1073741824" returned: 0 in 1.082s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:30 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 Sep 01 01:46:30 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:30 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261" returned: 0 in 0.467s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:46:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7568766c-7c96-4970-8bbb-96910c115e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f34749c-e2cd-4574-872a-cae661765261', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57278d93-6e92-4be3-92e2-25285ab3abb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:31 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Volume volume-9f34749c-e2cd-4574-872a-cae661765261 (9f34749c-e2cd-4574-872a-cae661765261): created successfully Sep 01 01:46:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57278d93-6e92-4be3-92e2-25285ab3abb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (5208a53d-378a-4898-8196-7281b70f463c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-33c69016-d717-46bc-b1a5-b07f84d65d84 tempest-VolumesActionsTest-729196085 None] Created volume successfully. Sep 01 01:46:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc4d8690-167d-4029-ae44-36c8e544cb16 tempest-VolumesActionsTest-729196085 None] Acquiring lock "cinder-9f34749c-e2cd-4574-872a-cae661765261" by "attach_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc4d8690-167d-4029-ae44-36c8e544cb16 tempest-VolumesActionsTest-729196085 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261" acquired by "attach_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bc4d8690-167d-4029-ae44-36c8e544cb16 tempest-VolumesActionsTest-729196085 None] Attaching volume 9f34749c-e2cd-4574-872a-cae661765261 to instance e6367608-47e8-4c6f-808a-1ff284a93e9c at mountpoint /dev/vdb on host None. Sep 01 01:46:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bc4d8690-167d-4029-ae44-36c8e544cb16 tempest-VolumesActionsTest-729196085 None] Attach volume completed successfully. Sep 01 01:46:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc4d8690-167d-4029-ae44-36c8e544cb16 tempest-VolumesActionsTest-729196085 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261" released by "attach_volume" :: held 0.178s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-40125c38-73d7-4790-a478-2570db7f3258 tempest-VolumesActionsTest-392839841 None] Terminate volume connection completed successfully. Sep 01 01:46:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-40125c38-73d7-4790-a478-2570db7f3258 tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-detach_volume" by "detach_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-40125c38-73d7-4790-a478-2570db7f3258 tempest-VolumesActionsTest-392839841 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-40125c38-73d7-4790-a478-2570db7f3258 tempest-VolumesActionsTest-392839841 None] Detaching volume 9f34749c-e2cd-4574-872a-cae661765261 from instance e6367608-47e8-4c6f-808a-1ff284a93e9c. Sep 01 01:46:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-40125c38-73d7-4790-a478-2570db7f3258 tempest-VolumesActionsTest-392839841 None] Detach volume completed successfully. Sep 01 01:46:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-40125c38-73d7-4790-a478-2570db7f3258 tempest-VolumesActionsTest-392839841 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c410b57a-e4bb-461e-a444-487537f30c5e tempest-VolumesActionsTest-729196085 None] Acquiring lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-detach_volume" by "detach_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c410b57a-e4bb-461e-a444-487537f30c5e tempest-VolumesActionsTest-729196085 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:34 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c410b57a-e4bb-461e-a444-487537f30c5e tempest-VolumesActionsTest-729196085 None] Volume detach called, but volume not attached. Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c410b57a-e4bb-461e-a444-487537f30c5e tempest-VolumesActionsTest-729196085 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Acquiring lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Acquiring lock "cinder-quobyte-9f34749c-e2cd-4574-872a-cae661765261" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Lock "cinder-quobyte-9f34749c-e2cd-4574-872a-cae661765261" acquired by "delete_volume" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb34687-4343-496b-af3a-3f03acec99aa]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:46:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:35 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 Sep 01 01:46:35 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:35 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261" returned: 0 in 0.905s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:35 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261 Sep 01 01:46:35 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:36 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9f34749c-e2cd-4574-872a-cae661765261" returned: 0 in 0.853s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Lock "cinder-quobyte-9f34749c-e2cd-4574-872a-cae661765261" released by "delete_volume" :: held 1.918s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:36 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Created reservations ['4e1b4719-1585-4f5e-bc46-b840b9e15e23', '499f41c2-c334-401e-851f-f8f68911cefd', 'acf75d34-8b6a-4d99-89bf-c0ddefb4c196', 'eb08cf35-67bf-4dda-8b01-425a4d951af6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:37 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:46:37 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:37 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.644s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:37 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:46:38 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Deleted volume successfully. Sep 01 01:46:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cfe115ad-a590-4612-a7b5-a93ccd7d640c tempest-VolumesActionsTest-729196085 None] Lock "cinder-9f34749c-e2cd-4574-872a-cae661765261-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:43 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:46:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (e4ec2249-c882-4902-b039-5fccaf6b6a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b8dd08-9a6c-43bc-9ae2-06fb9516f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b8dd08-9a6c-43bc-9ae2-06fb9516f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1209033690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a015c033-1473-4053-b675-a42e2ff985af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:44Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21edc55a-115e-4ffd-b8ed-bf34b6e3c4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21edc55a-115e-4ffd-b8ed-bf34b6e3c4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb55dd12-aaf7-4d2d-b7b5-16507a5cbe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb55dd12-aaf7-4d2d-b7b5-16507a5cbe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a015c033-1473-4053-b675-a42e2ff985af', 'volume_name': 'volume-a015c033-1473-4053-b675-a42e2ff985af', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fd4e43-7e7c-4f7e-89f9-4e0e19436abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fd4e43-7e7c-4f7e-89f9-4e0e19436abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a7496d-3b56-42f9-8f53-1c74b48029c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:44 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Volume a015c033-1473-4053-b675-a42e2ff985af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a015c033-1473-4053-b675-a42e2ff985af', 'volume_size': 1} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1209033690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a015c033-1473-4053-b675-a42e2ff985af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:44Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Creating volume a015c033-1473-4053-b675-a42e2ff985af {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:46:44 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:44 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af 1073741824 Sep 01 01:46:44 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:44 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af 1073741824" returned: 0 in 0.519s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:44 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af Sep 01 01:46:44 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:44 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af" returned: 0 in 0.284s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a7496d-3b56-42f9-8f53-1c74b48029c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a015c033-1473-4053-b675-a42e2ff985af', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f074ff6d-aae6-4ddb-83ad-a84ccf867030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:45 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Volume volume-a015c033-1473-4053-b675-a42e2ff985af (a015c033-1473-4053-b675-a42e2ff985af): created successfully Sep 01 01:46:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f074ff6d-aae6-4ddb-83ad-a84ccf867030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (e4ec2249-c882-4902-b039-5fccaf6b6a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-92f9bc66-274b-4926-b2b2-30d9eea9bb24 tempest-VolumesActionsTest-729196085 None] Created volume successfully. Sep 01 01:46:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-a015c033-1473-4053-b675-a42e2ff985af-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Lock "cinder-a015c033-1473-4053-b675-a42e2ff985af-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-quobyte-a015c033-1473-4053-b675-a42e2ff985af" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-a015c033-1473-4053-b675-a42e2ff985af" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:46 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac34343-2bcd-4a59-8a70-2c79fe134f3d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:46:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:46 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af Sep 01 01:46:46 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:47 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af" returned: 0 in 0.705s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:47 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af Sep 01 01:46:47 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:47 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a015c033-1473-4053-b675-a42e2ff985af" returned: 0 in 0.407s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-a015c033-1473-4053-b675-a42e2ff985af" released by "delete_volume" :: held 1.177s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Created reservations ['8238c0b8-6c77-4b89-8748-122683c1003b', '712bf45f-b779-456d-823e-49710dd1125c', '8d61f500-2e89-4db0-a3c4-ba8d85e42895', '607b9306-1797-4748-b7ee-65d24561c39c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:47 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:46:47 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:48 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.294s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:48 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:46:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Deleted volume successfully. Sep 01 01:46:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6b886cff-8fdd-49f9-b0ac-9f37408436b1 tempest-VolumesActionsTest-392839841 None] Lock "cinder-a015c033-1473-4053-b675-a42e2ff985af-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (e0151687-dea4-4828-ae1a-7f4407b38c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf4955c-7c1c-451f-8426-2f43aa24113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf4955c-7c1c-451f-8426-2f43aa24113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-801759199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c04a1b-5844-43ce-87be-b69f56e39f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:50Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92d6ed9-244b-466b-aaad-6f82b0270db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92d6ed9-244b-466b-aaad-6f82b0270db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78be286a-fb0d-42aa-b0df-49c5cfc1aac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78be286a-fb0d-42aa-b0df-49c5cfc1aac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c04a1b-5844-43ce-87be-b69f56e39f29', 'volume_name': 'volume-f6c04a1b-5844-43ce-87be-b69f56e39f29', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9697cc-97e0-4748-a1a8-1914aa45f890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9697cc-97e0-4748-a1a8-1914aa45f890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabcfe87-0d03-4a9e-b967-3290e2a7f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:49 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Volume f6c04a1b-5844-43ce-87be-b69f56e39f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c04a1b-5844-43ce-87be-b69f56e39f29', 'volume_size': 1} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-801759199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c04a1b-5844-43ce-87be-b69f56e39f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:50Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Creating volume f6c04a1b-5844-43ce-87be-b69f56e39f29 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:46:49 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:46:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:49 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 1073741824 Sep 01 01:46:49 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:50 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 1073741824" returned: 0 in 1.080s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:50 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 Sep 01 01:46:50 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:51 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29" returned: 0 in 0.367s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:46:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabcfe87-0d03-4a9e-b967-3290e2a7f701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c04a1b-5844-43ce-87be-b69f56e39f29', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5ab6f0-9381-4a80-b8cf-53a75489adc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Volume volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 (f6c04a1b-5844-43ce-87be-b69f56e39f29): created successfully Sep 01 01:46:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5ab6f0-9381-4a80-b8cf-53a75489adc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (e0151687-dea4-4828-ae1a-7f4407b38c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:51 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b435ed3e-baad-40a3-8ba8-b4500d9eb0ae tempest-VolumesActionsTest-729196085 None] Created volume successfully. Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-f6c04a1b-5844-43ce-87be-b69f56e39f29-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Lock "cinder-f6c04a1b-5844-43ce-87be-b69f56e39f29-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-quobyte-f6c04a1b-5844-43ce-87be-b69f56e39f29" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-f6c04a1b-5844-43ce-87be-b69f56e39f29" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae593728-69da-48e1-84cc-41bd0114ace4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:52 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 Sep 01 01:46:52 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:52 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29" returned: 0 in 0.607s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:52 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29 Sep 01 01:46:52 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:53 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6c04a1b-5844-43ce-87be-b69f56e39f29" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-f6c04a1b-5844-43ce-87be-b69f56e39f29" released by "delete_volume" :: held 0.970s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Created reservations ['3d889a48-5bca-493f-ab2c-6c65b46477cd', '7ce89e9e-7f5b-4e80-a117-944da6703cf5', 'f33744a2-b514-4862-b521-b2e9e3a95d47', '58ba94ed-f4f7-4fc1-a969-463c2713aab0'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:53 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:46:53 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:53 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.292s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:46:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Deleted volume successfully. Sep 01 01:46:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-90c367f9-a9ab-4a72-ba0f-be3abb0e4b2b tempest-VolumesActionsTest-392839841 None] Lock "cinder-f6c04a1b-5844-43ce-87be-b69f56e39f29-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (c9b18a23-d24b-480d-bb1a-4d34d63df0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa93def-b70e-45cb-8fa3-63234d6673a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa93def-b70e-45cb-8fa3-63234d6673a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-319363581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e970786b-31d3-4cfd-a04a-ad1d76eb3b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:55Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c0d1c1-c42c-4027-9d00-2f0b767013e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c0d1c1-c42c-4027-9d00-2f0b767013e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387972f7-6c3e-421f-aebf-a65501e4b6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387972f7-6c3e-421f-aebf-a65501e4b6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e970786b-31d3-4cfd-a04a-ad1d76eb3b6d', 'volume_name': 'volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c298da-9828-4c7c-a4a7-ff8dd8f26c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c298da-9828-4c7c-a4a7-ff8dd8f26c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61490dc5-28ca-463e-a88e-a5221649e3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:55 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Volume e970786b-31d3-4cfd-a04a-ad1d76eb3b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d', 'volume_size': 1} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-319363581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e970786b-31d3-4cfd-a04a-ad1d76eb3b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:46:55Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Creating volume e970786b-31d3-4cfd-a04a-ad1d76eb3b6d {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:46:55 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:46:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:55 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d 1073741824 Sep 01 01:46:55 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:56 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d 1073741824" returned: 0 in 0.694s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:56 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d Sep 01 01:46:56 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:56 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d" returned: 0 in 0.333s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61490dc5-28ca-463e-a88e-a5221649e3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37fc675-5127-4fc0-8982-7c3755930b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:46:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Volume volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d (e970786b-31d3-4cfd-a04a-ad1d76eb3b6d): created successfully Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37fc675-5127-4fc0-8982-7c3755930b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:46:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (c9b18a23-d24b-480d-bb1a-4d34d63df0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:46:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-59b8f6c2-1de1-48e8-8529-18b106aeaebb tempest-VolumesActionsTest-729196085 None] Created volume successfully. Sep 01 01:46:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Lock "cinder-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-quobyte-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:46:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:46:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ff6c3c-8697-44c5-824d-75d00f9974a0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:46:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:57 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d Sep 01 01:46:57 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:58 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d" returned: 0 in 0.630s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:58 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d Sep 01 01:46:58 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:58 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d" returned: 0 in 0.528s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d" released by "delete_volume" :: held 1.249s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Created reservations ['9c14c57f-7cfe-49ad-8b42-6193ea226114', '00ddb182-64cc-410b-963c-b0d87f7059dd', '8083e073-fb48-4fbb-87ec-122645628d0e', '843a4ea8-5f24-473c-8e65-fd87a8f0db04'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:46:59 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:46:59 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:46:59 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.524s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:46:59 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Deleted volume successfully. Sep 01 01:46:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b5a30e57-fbfd-4bd7-bce6-22b66e9855fb tempest-VolumesActionsTest-392839841 None] Lock "cinder-e970786b-31d3-4cfd-a04a-ad1d76eb3b6d-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (dbfcc5df-4ea5-4873-9429-43cfc68c32c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2683cddd-434b-49ea-8b30-f1f554a3d5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2683cddd-434b-49ea-8b30-f1f554a3d5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-192039986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e084675-eb1f-4d62-be49-5bc36fc0faa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:01Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18c4d43-caea-491d-b6ac-95debb13e37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18c4d43-caea-491d-b6ac-95debb13e37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70b852f-852c-4adc-a67c-274633b0547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70b852f-852c-4adc-a67c-274633b0547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e084675-eb1f-4d62-be49-5bc36fc0faa0', 'volume_name': 'volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fdeb61-771d-43b8-ae45-fcce2c2e8dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fdeb61-771d-43b8-ae45-fcce2c2e8dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549b6bc6-4ad9-412b-9047-56149ba0632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:01 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Volume 2e084675-eb1f-4d62-be49-5bc36fc0faa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0', 'volume_size': 1} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-192039986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e084675-eb1f-4d62-be49-5bc36fc0faa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:01Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Creating volume 2e084675-eb1f-4d62-be49-5bc36fc0faa0 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:01 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:01 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 1073741824 Sep 01 01:47:01 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:02 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 1073741824" returned: 0 in 0.647s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:02 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 Sep 01 01:47:02 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:02 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0" returned: 0 in 0.291s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549b6bc6-4ad9-412b-9047-56149ba0632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63e1c69-4ad2-4194-b8b3-6b3de638a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:02 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Volume volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 (2e084675-eb1f-4d62-be49-5bc36fc0faa0): created successfully Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63e1c69-4ad2-4194-b8b3-6b3de638a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (dbfcc5df-4ea5-4873-9429-43cfc68c32c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:02 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f1fadbc6-7c22-479d-ac6e-f92b16645cde tempest-VolumesActionsTest-729196085 None] Created volume successfully. Sep 01 01:47:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-2e084675-eb1f-4d62-be49-5bc36fc0faa0-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Lock "cinder-2e084675-eb1f-4d62-be49-5bc36fc0faa0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Acquiring lock "cinder-quobyte-2e084675-eb1f-4d62-be49-5bc36fc0faa0" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-2e084675-eb1f-4d62-be49-5bc36fc0faa0" acquired by "delete_volume" :: waited 0.058s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b81bc50-b826-4eac-bf35-35d89ef2350d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:04 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 Sep 01 01:47:04 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:04 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0" returned: 0 in 0.788s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:04 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0 Sep 01 01:47:04 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:05 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e084675-eb1f-4d62-be49-5bc36fc0faa0" returned: 0 in 0.421s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Lock "cinder-quobyte-2e084675-eb1f-4d62-be49-5bc36fc0faa0" released by "delete_volume" :: held 1.367s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Created reservations ['a5085aa6-bd44-41f8-8dda-c7018c5f5e66', '0637880b-2721-4d5d-ba4d-46773555efaa', 'cfe5e965-41be-4a7c-90d1-b346ba72802f', 'b96e8989-cae2-46e5-a107-016698631bbf'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:05 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:05 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:06 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.463s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:06 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:06 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Deleted volume successfully. Sep 01 01:47:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2c338a44-d091-42ab-aec7-83ad532f1027 tempest-VolumesActionsTest-392839841 None] Lock "cinder-2e084675-eb1f-4d62-be49-5bc36fc0faa0-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-1eaa6614-d117-40ff-86c9-0adb966ed945 req-12e8e612-4b6d-45da-9b2c-c6f50b192176 tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-1eaa6614-d117-40ff-86c9-0adb966ed945 req-12e8e612-4b6d-45da-9b2c-c6f50b192176 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-1eaa6614-d117-40ff-86c9-0adb966ed945 req-12e8e612-4b6d-45da-9b2c-c6f50b192176 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-1eaa6614-d117-40ff-86c9-0adb966ed945 req-12e8e612-4b6d-45da-9b2c-c6f50b192176 tempest-TestServerVolumeAttachmentScenario-3325454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b45dc33-ec1f-40bf-8297-687e55a613eb', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (b5993fbd-e1b1-4128-a627-83b8dfd76198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1e5e66-93bc-4324-b4a0-f85d9d0e6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1e5e66-93bc-4324-b4a0-f85d9d0e6269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1138454494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b538a144-4a48-4e52-b76c-65d41d644710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:07Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f41a79-1f06-4484-a3f2-ab76ffc23265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f41a79-1f06-4484-a3f2-ab76ffc23265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9948355-e7ec-4e3e-9276-4c7b283ed801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9948355-e7ec-4e3e-9276-4c7b283ed801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b538a144-4a48-4e52-b76c-65d41d644710', 'volume_name': 'volume-b538a144-4a48-4e52-b76c-65d41d644710', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c64ea8f-1e61-475e-8758-7a00514600aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c64ea8f-1e61-475e-8758-7a00514600aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5774d96c-4312-4a83-baac-1f4c2088519a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:07 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Volume b538a144-4a48-4e52-b76c-65d41d644710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b538a144-4a48-4e52-b76c-65d41d644710', 'volume_size': 1} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1138454494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b538a144-4a48-4e52-b76c-65d41d644710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92072d9430944ab796ad99ddf078c045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:07Z,use_quota=True,user_id='4bceb1551e0641bd94880a5c35ff32f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Creating volume b538a144-4a48-4e52-b76c-65d41d644710 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:07 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-1eaa6614-d117-40ff-86c9-0adb966ed945 req-12e8e612-4b6d-45da-9b2c-c6f50b192176 tempest-TestServerVolumeAttachmentScenario-3325454 None] attachment_update completed successfully. Sep 01 01:47:07 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 1073741824 Sep 01 01:47:07 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:08 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 1073741824" returned: 0 in 1.002s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:08 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 Sep 01 01:47:08 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:09 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710" returned: 0 in 0.627s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5774d96c-4312-4a83-baac-1f4c2088519a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b538a144-4a48-4e52-b76c-65d41d644710', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9bfe37-9c60-415d-924d-8830c4e476b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:09 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Volume volume-b538a144-4a48-4e52-b76c-65d41d644710 (b538a144-4a48-4e52-b76c-65d41d644710): created successfully Sep 01 01:47:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9bfe37-9c60-415d-924d-8830c4e476b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Flow 'volume_create_manager' (b5993fbd-e1b1-4128-a627-83b8dfd76198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-81621f28-1d50-4188-912c-5669f35358d5 tempest-VolumesActionsTest-729196085 None] Created volume successfully. Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Acquiring lock "cinder-b538a144-4a48-4e52-b76c-65d41d644710-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Lock "cinder-b538a144-4a48-4e52-b76c-65d41d644710-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=69,cinder:SELECT=60,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Acquiring lock "cinder-quobyte-b538a144-4a48-4e52-b76c-65d41d644710" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Lock "cinder-quobyte-b538a144-4a48-4e52-b76c-65d41d644710" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a822e0f-3199-4c72-9d15-e8296031d209]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:11 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 Sep 01 01:47:11 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:11 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710" returned: 0 in 0.387s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:11 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710 Sep 01 01:47:11 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:12 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b538a144-4a48-4e52-b76c-65d41d644710" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Lock "cinder-quobyte-b538a144-4a48-4e52-b76c-65d41d644710" released by "delete_volume" :: held 0.731s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=56,cinder:UPDATE=71,cinder:DELETE=8,cinder:INSERT=10 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Created reservations ['191d7a77-0565-43c5-8e9d-467343925551', '66f0f875-250c-48c7-b1f3-1855ee3ea21b', '53081344-1fda-4f8e-8483-6a6a5bb8f1e4', '307b287c-0757-4e1f-bb9a-0e800fb65a1a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:12 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:12 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:12 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.349s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Deleted volume successfully. Sep 01 01:47:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1ff96d40-77de-43e7-b66f-d5b65a8c3428 tempest-VolumesActionsTest-729196085 None] Lock "cinder-b538a144-4a48-4e52-b76c-65d41d644710-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-f8a274eb-deaf-4680-8b82-b8a1bada8785 req-e2ca0afa-a6ac-4f5a-ba5d-b87f48baea93 tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-f8a274eb-deaf-4680-8b82-b8a1bada8785 req-e2ca0afa-a6ac-4f5a-ba5d-b87f48baea93 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-f8a274eb-deaf-4680-8b82-b8a1bada8785 req-e2ca0afa-a6ac-4f5a-ba5d-b87f48baea93 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-f8a274eb-deaf-4680-8b82-b8a1bada8785 req-e2ca0afa-a6ac-4f5a-ba5d-b87f48baea93 tempest-TestServerVolumeAttachmentScenario-3325454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-bbc4063a-8602-4e9d-a016-c8b7caa08280', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13c443a4-1622-470a-b0d3-b210fa8b1afd', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:47:13 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-f8a274eb-deaf-4680-8b82-b8a1bada8785 req-e2ca0afa-a6ac-4f5a-ba5d-b87f48baea93 tempest-TestServerVolumeAttachmentScenario-3325454 None] attachment_update completed successfully. Sep 01 01:47:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-6013e9b7-a4a5-4203-bdfe-302d34796dc7 req-3635a419-c3e3-4935-9c23-765b9cbae8e2 tempest-TestServerVolumeAttachmentScenario-3325454 None] Terminate volume connection completed successfully. Sep 01 01:47:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-6013e9b7-a4a5-4203-bdfe-302d34796dc7 req-3635a419-c3e3-4935-9c23-765b9cbae8e2 tempest-TestServerVolumeAttachmentScenario-3325454 None] Deleting attachment 13c443a4-1622-470a-b0d3-b210fa8b1afd. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:17 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:17 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:17 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:47:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:47:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-2a1b72cb-8f45-40a9-afb5-eb12f4c9791c req-d1e7ac2a-818f-4dc4-a4ef-c909e7cd75b5 tempest-TestServerVolumeAttachmentScenario-3325454 None] Terminate volume connection completed successfully. Sep 01 01:47:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-2a1b72cb-8f45-40a9-afb5-eb12f4c9791c req-d1e7ac2a-818f-4dc4-a4ef-c909e7cd75b5 tempest-TestServerVolumeAttachmentScenario-3325454 None] Deleting attachment 2b45dc33-ec1f-40bf-8297-687e55a613eb. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Flow 'volume_create_manager' (66a70bb1-785d-43bd-b744-727e316ed4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc8371e-95f9-43f6-89f0-3c0d370be3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc8371e-95f9-43f6-89f0-3c0d370be3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-686061761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8200206-2279-4d78-8da1-f905db65c8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50511ceba19749219a8f3f2092f7177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:24Z,use_quota=True,user_id='6fe3c2c1027c462bafc91e96186b52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5412d6-5606-4c50-a015-144c2aeaa6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5412d6-5606-4c50-a015-144c2aeaa6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83823d34-4058-40ba-bf9e-156bb6a6d469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83823d34-4058-40ba-bf9e-156bb6a6d469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8200206-2279-4d78-8da1-f905db65c8c9', 'volume_name': 'volume-f8200206-2279-4d78-8da1-f905db65c8c9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84759fd1-1f52-41b1-b122-ccc22b55450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84759fd1-1f52-41b1-b122-ccc22b55450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bff2270-e67c-405d-845a-4a48c2e2ae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:23 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Volume f8200206-2279-4d78-8da1-f905db65c8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8200206-2279-4d78-8da1-f905db65c8c9', 'volume_size': 1} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-686061761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8200206-2279-4d78-8da1-f905db65c8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50511ceba19749219a8f3f2092f7177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:24Z,use_quota=True,user_id='6fe3c2c1027c462bafc91e96186b52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Creating volume f8200206-2279-4d78-8da1-f905db65c8c9 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:23 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:23 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 1073741824 Sep 01 01:47:23 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:24 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 1073741824" returned: 0 in 0.576s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "cinder-bbc4063a-8602-4e9d-a016-c8b7caa08280-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-bbc4063a-8602-4e9d-a016-c8b7caa08280-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "cinder-quobyte-bbc4063a-8602-4e9d-a016-c8b7caa08280" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:24 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 Sep 01 01:47:24 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-quobyte-bbc4063a-8602-4e9d-a016-c8b7caa08280" acquired by "delete_volume" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc7b50f-96ca-4e3f-b2ef-e4acee17d9d3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:24 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 Sep 01 01:47:24 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:24 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9" returned: 0 in 0.283s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bff2270-e67c-405d-845a-4a48c2e2ae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8200206-2279-4d78-8da1-f905db65c8c9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1401a6-635d-4825-94a2-fa414b8fd805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:24 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Volume volume-f8200206-2279-4d78-8da1-f905db65c8c9 (f8200206-2279-4d78-8da1-f905db65c8c9): created successfully Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1401a6-635d-4825-94a2-fa414b8fd805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Flow 'volume_create_manager' (66a70bb1-785d-43bd-b744-727e316ed4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:24 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c30d726f-5e46-4870-8545-6781d35d61be tempest-AttachVolumeNegativeTest-753336702 None] Created volume successfully. Sep 01 01:47:24 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280" returned: 0 in 0.446s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:24 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280 Sep 01 01:47:24 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:25 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bbc4063a-8602-4e9d-a016-c8b7caa08280" returned: 0 in 0.358s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-quobyte-bbc4063a-8602-4e9d-a016-c8b7caa08280" released by "delete_volume" :: held 0.858s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Created reservations ['5b93c4ed-f72e-4da6-8766-d467110a31d7', '40583730-4614-4861-95c1-271af580fd2f', 'a8ebc3f1-a4bd-44a7-93f6-c787b53c4702', '6c8ea1e9-b38d-41cc-8031-2eff25490de7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:25 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:25 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "cinder-ddf33353-8dc0-4190-9e75-ff9b0cf34a81-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-ddf33353-8dc0-4190-9e75-ff9b0cf34a81-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "cinder-quobyte-ddf33353-8dc0-4190-9e75-ff9b0cf34a81" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-quobyte-ddf33353-8dc0-4190-9e75-ff9b0cf34a81" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe55bd-ba32-4796-bb4c-7776ad8d67c8]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:25 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.415s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Deleted volume successfully. Sep 01 01:47:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-778b782e-66f0-4cca-b388-bef20f670a17 tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-bbc4063a-8602-4e9d-a016-c8b7caa08280-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:25 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 Sep 01 01:47:25 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:26 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81" returned: 0 in 0.837s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:26 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81 Sep 01 01:47:26 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:26 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ddf33353-8dc0-4190-9e75-ff9b0cf34a81" returned: 0 in 0.336s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-950e549e-140c-4b8b-b721-262721cb168e req-83acbf16-7d47-49ca-a9ca-82ceb1a3c5ae tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-950e549e-140c-4b8b-b721-262721cb168e req-83acbf16-7d47-49ca-a9ca-82ceb1a3c5ae tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-quobyte-ddf33353-8dc0-4190-9e75-ff9b0cf34a81" released by "delete_volume" :: held 1.251s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-950e549e-140c-4b8b-b721-262721cb168e req-83acbf16-7d47-49ca-a9ca-82ceb1a3c5ae tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-950e549e-140c-4b8b-b721-262721cb168e req-83acbf16-7d47-49ca-a9ca-82ceb1a3c5ae tempest-AttachVolumeNegativeTest-753336702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-f8200206-2279-4d78-8da1-f905db65c8c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd86cd1be-938a-44ab-b5f0-88a9b769b023', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Created reservations ['32517e43-6040-4102-9fc7-1024bfcf2237', '5f9af783-9d2b-4a8d-95ee-41570cc5a47c', '17973930-afac-439b-b3d3-0d1b0be5c179', '309e0624-e4c1-4622-90f7-3273e717e9f4'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-950e549e-140c-4b8b-b721-262721cb168e req-83acbf16-7d47-49ca-a9ca-82ceb1a3c5ae tempest-AttachVolumeNegativeTest-753336702 None] attachment_update completed successfully. Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:27 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:27 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:27 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Deleted volume successfully. Sep 01 01:47:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4ffaed2a-5568-4676-a6c0-021510e59dfd tempest-TestServerVolumeAttachmentScenario-3325454 None] Lock "cinder-ddf33353-8dc0-4190-9e75-ff9b0cf34a81-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Flow 'volume_create_manager' (c1f3410a-c3cd-439b-8c18-9f84cf7431cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4872d02-4585-4983-b5fc-f89677527bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4872d02-4585-4983-b5fc-f89677527bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1810112005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412e17ac-1669-4cff-a9dd-fa3a784a6f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386377dc807546c0830a1fe7a54bfda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:30Z,use_quota=True,user_id='03640ab7cf144089918836a929a80cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9ec4f5-6bb0-489a-a960-19d5743074e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9ec4f5-6bb0-489a-a960-19d5743074e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dceca3-3e92-4e42-ba36-e8da101e1625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27dceca3-3e92-4e42-ba36-e8da101e1625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412e17ac-1669-4cff-a9dd-fa3a784a6f08', 'volume_name': 'volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8847a8d8-d7dc-4476-b510-b33edfab88df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8847a8d8-d7dc-4476-b510-b33edfab88df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e4fce1-55ea-4d1c-8bcc-a85ab6300c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Volume 412e17ac-1669-4cff-a9dd-fa3a784a6f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08', 'volume_size': 1} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1810112005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412e17ac-1669-4cff-a9dd-fa3a784a6f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386377dc807546c0830a1fe7a54bfda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:30Z,use_quota=True,user_id='03640ab7cf144089918836a929a80cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Creating volume 412e17ac-1669-4cff-a9dd-fa3a784a6f08 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:30 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:30 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 1073741824 Sep 01 01:47:30 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-0db10d6a-fbfb-49f2-a398-29981ffec902 req-4f84e5e1-c5e2-46e9-91e4-4b86a4f30c1b tempest-AttachVolumeNegativeTest-753336702 None] Terminate volume connection completed successfully. Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-0db10d6a-fbfb-49f2-a398-29981ffec902 req-4f84e5e1-c5e2-46e9-91e4-4b86a4f30c1b tempest-AttachVolumeNegativeTest-753336702 None] Deleting attachment d86cd1be-938a-44ab-b5f0-88a9b769b023. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Flow 'volume_create_manager' (7e510cb0-54a3-45b6-b5ca-69e80507317d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386fed25-97fa-48bf-9197-f5625d1c205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386fed25-97fa-48bf-9197-f5625d1c205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-904952298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302aad13-c99e-41b1-a95d-af0af20268d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17e63c8e8134985a3f874a2a11cfe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:31Z,use_quota=True,user_id='00cea3639e464615990a410d40cee882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2099e216-0b86-40b4-a375-d5b731488999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2099e216-0b86-40b4-a375-d5b731488999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dce22f-223b-43c0-a03e-a36b2f5a3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dce22f-223b-43c0-a03e-a36b2f5a3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302aad13-c99e-41b1-a95d-af0af20268d6', 'volume_name': 'volume-302aad13-c99e-41b1-a95d-af0af20268d6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9caf38-8667-45a7-ac13-ea234b3b903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9caf38-8667-45a7-ac13-ea234b3b903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd9dcf0-2d5b-4815-b477-d462128223b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Volume 302aad13-c99e-41b1-a95d-af0af20268d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302aad13-c99e-41b1-a95d-af0af20268d6', 'volume_size': 1} Sep 01 01:47:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:31 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 1073741824" returned: 0 in 0.805s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:31 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 Sep 01 01:47:31 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:31 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08" returned: 0 in 0.498s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-904952298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302aad13-c99e-41b1-a95d-af0af20268d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17e63c8e8134985a3f874a2a11cfe44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:31Z,use_quota=True,user_id='00cea3639e464615990a410d40cee882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Creating volume 302aad13-c99e-41b1-a95d-af0af20268d6 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:31 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e4fce1-55ea-4d1c-8bcc-a85ab6300c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77de9074-7203-4a70-81fa-ac2423a2536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:31 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 1073741824 Sep 01 01:47:31 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:31 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Volume volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 (412e17ac-1669-4cff-a9dd-fa3a784a6f08): created successfully Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77de9074-7203-4a70-81fa-ac2423a2536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Flow 'volume_create_manager' (c1f3410a-c3cd-439b-8c18-9f84cf7431cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9d307703-c33f-496c-a55e-fa1b82b851ff tempest-VolumesListAdminTestJSON-1991971392 None] Created volume successfully. Sep 01 01:47:32 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 1073741824" returned: 0 in 0.655s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:32 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 Sep 01 01:47:32 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:32 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6" returned: 0 in 0.385s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd9dcf0-2d5b-4815-b477-d462128223b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302aad13-c99e-41b1-a95d-af0af20268d6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110a5209-6ea3-4462-a51f-ace31364f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Volume volume-302aad13-c99e-41b1-a95d-af0af20268d6 (302aad13-c99e-41b1-a95d-af0af20268d6): created successfully Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110a5209-6ea3-4462-a51f-ace31364f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Flow 'volume_create_manager' (7e510cb0-54a3-45b6-b5ca-69e80507317d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-07865886-c02f-4b6f-b373-f0523a556063 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Created volume successfully. Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Flow 'volume_create_manager' (56fe0002-fbde-4198-a835-d8b0776ff3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac32f57-67c5-48af-84a0-159d8050624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac32f57-67c5-48af-84a0-159d8050624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-711354799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0601bb9-a962-4b82-8316-254cee35e7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386377dc807546c0830a1fe7a54bfda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:33Z,use_quota=True,user_id='03640ab7cf144089918836a929a80cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aeeeb7c-9676-4f10-b9a7-ecaa1fad1b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aeeeb7c-9676-4f10-b9a7-ecaa1fad1b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58890ba2-1bfe-4f88-b18b-a80a8c1fccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58890ba2-1bfe-4f88-b18b-a80a8c1fccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0601bb9-a962-4b82-8316-254cee35e7e3', 'volume_name': 'volume-e0601bb9-a962-4b82-8316-254cee35e7e3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a25d30e-5f0f-465f-97e6-6692f1f2e873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a25d30e-5f0f-465f-97e6-6692f1f2e873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94cf076-0732-44c5-ba36-876235c2ead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Volume e0601bb9-a962-4b82-8316-254cee35e7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0601bb9-a962-4b82-8316-254cee35e7e3', 'volume_size': 1} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-711354799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0601bb9-a962-4b82-8316-254cee35e7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386377dc807546c0830a1fe7a54bfda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:33Z,use_quota=True,user_id='03640ab7cf144089918836a929a80cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Creating volume e0601bb9-a962-4b82-8316-254cee35e7e3 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:32 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:33 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 1073741824 Sep 01 01:47:33 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:33 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 1073741824" returned: 0 in 0.751s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:33 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 Sep 01 01:47:33 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:34 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3" returned: 0 in 0.361s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94cf076-0732-44c5-ba36-876235c2ead9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0601bb9-a962-4b82-8316-254cee35e7e3', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9805d292-eddc-4011-aa15-a5f4feeff5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:34 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Volume volume-e0601bb9-a962-4b82-8316-254cee35e7e3 (e0601bb9-a962-4b82-8316-254cee35e7e3): created successfully Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9805d292-eddc-4011-aa15-a5f4feeff5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Flow 'volume_create_manager' (56fe0002-fbde-4198-a835-d8b0776ff3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:34 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3da00a6f-10b8-4064-a7d7-7e49a229decd tempest-VolumesListAdminTestJSON-1991971392 None] Created volume successfully. Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-15ea6aca-cd74-4a69-9c1e-c3abad035044 req-a302ae7b-3b06-4c03-8f3e-dde7d62a2a65 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-15ea6aca-cd74-4a69-9c1e-c3abad035044 req-a302ae7b-3b06-4c03-8f3e-dde7d62a2a65 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-15ea6aca-cd74-4a69-9c1e-c3abad035044 req-a302ae7b-3b06-4c03-8f3e-dde7d62a2a65 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-15ea6aca-cd74-4a69-9c1e-c3abad035044 req-a302ae7b-3b06-4c03-8f3e-dde7d62a2a65 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-302aad13-c99e-41b1-a95d-af0af20268d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bd1de7d-96e6-420c-aa56-19ce71c1532c', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:47:34 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-15ea6aca-cd74-4a69-9c1e-c3abad035044 req-a302ae7b-3b06-4c03-8f3e-dde7d62a2a65 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] attachment_update completed successfully. Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Flow 'volume_create_manager' (d159924e-bf52-4741-b3a5-7db1d4787415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d5545-a103-47e4-876b-2967c9b62b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d5545-a103-47e4-876b-2967c9b62b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-118761390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1408f576-cf51-4610-8b68-635c93ef9a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386377dc807546c0830a1fe7a54bfda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:36Z,use_quota=True,user_id='03640ab7cf144089918836a929a80cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425a6b7c-2a28-418a-8487-54af231b23fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425a6b7c-2a28-418a-8487-54af231b23fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55432b0e-f22b-4477-8796-32e97370e2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55432b0e-f22b-4477-8796-32e97370e2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1408f576-cf51-4610-8b68-635c93ef9a10', 'volume_name': 'volume-1408f576-cf51-4610-8b68-635c93ef9a10', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb4e7e7-e488-45db-8c7a-c484c99ee157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb4e7e7-e488-45db-8c7a-c484c99ee157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e676f26-8e82-4484-a807-f275fb2bb984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:35 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Volume 1408f576-cf51-4610-8b68-635c93ef9a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1408f576-cf51-4610-8b68-635c93ef9a10', 'volume_size': 1} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-118761390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1408f576-cf51-4610-8b68-635c93ef9a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='386377dc807546c0830a1fe7a54bfda7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:36Z,use_quota=True,user_id='03640ab7cf144089918836a929a80cbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Creating volume 1408f576-cf51-4610-8b68-635c93ef9a10 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:35 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:35 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 1073741824 Sep 01 01:47:35 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:36 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 1073741824" returned: 0 in 0.603s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:36 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 Sep 01 01:47:36 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:36 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10" returned: 0 in 0.371s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e676f26-8e82-4484-a807-f275fb2bb984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1408f576-cf51-4610-8b68-635c93ef9a10', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9c2b07-7054-4f15-bc39-21e1b2b252af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Volume volume-1408f576-cf51-4610-8b68-635c93ef9a10 (1408f576-cf51-4610-8b68-635c93ef9a10): created successfully Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb9c2b07-7054-4f15-bc39-21e1b2b252af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Flow 'volume_create_manager' (d159924e-bf52-4741-b3a5-7db1d4787415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-271a6790-edf3-48d8-a473-5b3c656c110b tempest-VolumesListAdminTestJSON-1991971392 None] Created volume successfully. Sep 01 01:47:37 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-161e71a8-1119-4add-9868-09247c31a918 req-a78d6868-0ff7-43ab-b0b6-0cf78d1bf4d1 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Terminate volume connection completed successfully. Sep 01 01:47:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-161e71a8-1119-4add-9868-09247c31a918 req-a78d6868-0ff7-43ab-b0b6-0cf78d1bf4d1 tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Deleting attachment 9bd1de7d-96e6-420c-aa56-19ce71c1532c. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Acquiring lock "cinder-302aad13-c99e-41b1-a95d-af0af20268d6-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "cinder-302aad13-c99e-41b1-a95d-af0af20268d6-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Flow 'volume_create_manager' (76081cab-f973-4161-8651-c812e0a0b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c60df4-8bd4-49fc-b6fe-e594f4b272be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c60df4-8bd4-49fc-b6fe-e594f4b272be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0170a1-5eca-4c6f-a446-6cf006fa7f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f05437e867b4c9a94b78061dade5605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:39Z,use_quota=True,user_id='9355c2147ad94470a9e89d8e35ef607d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7d7c89-ee90-44b9-aa41-779a5d28a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7d7c89-ee90-44b9-aa41-779a5d28a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea56a34-c1fb-472c-9ab9-20f64e001097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea56a34-c1fb-472c-9ab9-20f64e001097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0170a1-5eca-4c6f-a446-6cf006fa7f93', 'volume_name': 'volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475936b2-e0c0-4b68-8dd4-0d86e3fb7202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (475936b2-e0c0-4b68-8dd4-0d86e3fb7202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0319a-d138-41ec-90ef-48d91803f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Volume 1e0170a1-5eca-4c6f-a446-6cf006fa7f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93', 'volume_size': 1} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0170a1-5eca-4c6f-a446-6cf006fa7f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f05437e867b4c9a94b78061dade5605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:39Z,use_quota=True,user_id='9355c2147ad94470a9e89d8e35ef607d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Creating volume 1e0170a1-5eca-4c6f-a446-6cf006fa7f93 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:38 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Acquiring lock "cinder-quobyte-302aad13-c99e-41b1-a95d-af0af20268d6" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:38 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 1073741824 Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "cinder-quobyte-302aad13-c99e-41b1-a95d-af0af20268d6" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:38 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b612f4-b987-437e-87dd-26ac7639dc59]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:39 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 Sep 01 01:47:39 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:39 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:39 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6 Sep 01 01:47:39 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:39 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 1073741824" returned: 0 in 0.518s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:39 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 Sep 01 01:47:39 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:39 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-302aad13-c99e-41b1-a95d-af0af20268d6" returned: 0 in 0.298s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "cinder-quobyte-302aad13-c99e-41b1-a95d-af0af20268d6" released by "delete_volume" :: held 0.767s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:39 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93" returned: 0 in 0.299s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e0319a-d138-41ec-90ef-48d91803f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edfac38-e9d4-4228-ae38-f4e73f41b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Created reservations ['63948a68-27d6-4206-b91f-0793c3b59dd7', 'd4a49a99-5725-4b92-8f4f-b242a703b294', '342aef20-59cd-4571-8878-51cd6e73bb8e', '0b9bc75a-9ce9-4cd2-8583-78a918cbb8d3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Volume volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 (1e0170a1-5eca-4c6f-a446-6cf006fa7f93): created successfully Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edfac38-e9d4-4228-ae38-f4e73f41b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Flow 'volume_create_manager' (76081cab-f973-4161-8651-c812e0a0b636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9c3e3c08-43fd-4cf3-bf8b-4b269ba0c5ed tempest-VolumesListAdminTestJSON-1856225206 None] Created volume successfully. Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:40 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:40 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:40 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.323s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:40 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:40 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Deleted volume successfully. Sep 01 01:47:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-182d0ba2-3efc-4198-a424-bbf7743cdc1e tempest-TestServerVolumeAttachScenarioOldVersion-109089242 None] Lock "cinder-302aad13-c99e-41b1-a95d-af0af20268d6-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Acquiring lock "cinder-1e0170a1-5eca-4c6f-a446-6cf006fa7f93-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Lock "cinder-1e0170a1-5eca-4c6f-a446-6cf006fa7f93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Acquiring lock "cinder-quobyte-1e0170a1-5eca-4c6f-a446-6cf006fa7f93" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Lock "cinder-quobyte-1e0170a1-5eca-4c6f-a446-6cf006fa7f93" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afd2df8-d56b-4ee3-b701-29da7d80f659]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "cinder-1408f576-cf51-4610-8b68-635c93ef9a10-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-1408f576-cf51-4610-8b68-635c93ef9a10-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:41 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 Sep 01 01:47:41 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "cinder-quobyte-1408f576-cf51-4610-8b68-635c93ef9a10" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-quobyte-1408f576-cf51-4610-8b68-635c93ef9a10" acquired by "delete_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee467a1d-10db-4935-8069-44a0fa834da2]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:41 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 Sep 01 01:47:41 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:41 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93" returned: 0 in 0.811s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:42 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93 Sep 01 01:47:42 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:42 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10" returned: 0 in 0.805s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:42 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10 Sep 01 01:47:42 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:42 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1e0170a1-5eca-4c6f-a446-6cf006fa7f93" returned: 0 in 0.406s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Lock "cinder-quobyte-1e0170a1-5eca-4c6f-a446-6cf006fa7f93" released by "delete_volume" :: held 1.350s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Created reservations ['46c809cf-f143-4aec-ae7e-cd06667615b4', 'edc092ef-202b-45e1-a2d6-985d9228ab55', '904397d9-e416-401d-88ec-72627381d786', 'd828ff9f-712a-45ac-8ead-11b700b0c5e6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:42 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:42 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:42 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1408f576-cf51-4610-8b68-635c93ef9a10" returned: 0 in 0.565s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-quobyte-1408f576-cf51-4610-8b68-635c93ef9a10" released by "delete_volume" :: held 1.469s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:42 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Created reservations ['eca2c997-bd9b-4586-8faf-9a5899f40781', '4e850f93-f1c5-4881-9e46-2e679b261e72', 'fbe8a39a-c784-4b89-b406-37fa86d12f0b', '464de18d-bca7-4643-8524-2a74560ab5ef'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:43 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Deleted volume successfully. Sep 01 01:47:43 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:43 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-597003e0-3663-4244-b1ae-1031542c232c tempest-VolumesListAdminTestJSON-1856225206 None] Lock "cinder-1e0170a1-5eca-4c6f-a446-6cf006fa7f93-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:43 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.431s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Deleted volume successfully. Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f3f3680b-8311-4961-be41-11e91750c495 tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-1408f576-cf51-4610-8b68-635c93ef9a10-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "cinder-e0601bb9-a962-4b82-8316-254cee35e7e3-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-e0601bb9-a962-4b82-8316-254cee35e7e3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "cinder-quobyte-e0601bb9-a962-4b82-8316-254cee35e7e3" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-quobyte-e0601bb9-a962-4b82-8316-254cee35e7e3" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568eef2-016d-4096-be13-bbbf825afed0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:43 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 Sep 01 01:47:43 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:44 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3" returned: 0 in 0.440s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:44 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3 Sep 01 01:47:44 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:44 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e0601bb9-a962-4b82-8316-254cee35e7e3" returned: 0 in 0.323s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-quobyte-e0601bb9-a962-4b82-8316-254cee35e7e3" released by "delete_volume" :: held 0.825s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Created reservations ['ba7b15f5-a177-401b-ae82-a426f4c70153', '4b4fe6b2-c86a-4334-8121-9250218785a2', '5c4eb109-3206-450d-9b9e-95915a9137a3', '461d5fdb-e723-436f-9fa3-5ef8b20216e4'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:44 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:44 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "cinder-412e17ac-1669-4cff-a9dd-fa3a784a6f08-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-412e17ac-1669-4cff-a9dd-fa3a784a6f08-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "cinder-quobyte-412e17ac-1669-4cff-a9dd-fa3a784a6f08" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-quobyte-412e17ac-1669-4cff-a9dd-fa3a784a6f08" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d9cf9-04d1-4f27-bd99-eee2e25fc4c0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:45 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.412s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Deleted volume successfully. Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be033ee5-1055-431f-a57e-c768798be5ea tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-e0601bb9-a962-4b82-8316-254cee35e7e3-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:45 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 Sep 01 01:47:45 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:45 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08" returned: 0 in 0.446s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:45 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08 Sep 01 01:47:45 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:46 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-412e17ac-1669-4cff-a9dd-fa3a784a6f08" returned: 0 in 0.339s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-quobyte-412e17ac-1669-4cff-a9dd-fa3a784a6f08" released by "delete_volume" :: held 0.849s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Created reservations ['ae0a369b-4877-4e64-b88d-a603691bad69', 'f0848736-9756-4051-bffa-6520b837c693', 'c90b87f1-7ab1-4fa0-a6e2-97323c1511ac', '6d4e8265-e5a3-4445-9a27-63e679173da3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:46 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:46 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:47 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.639s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:47 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Deleted volume successfully. Sep 01 01:47:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec71116c-33ab-42ab-8e5c-43a66d4cd4ae tempest-VolumesListAdminTestJSON-1991971392 None] Lock "cinder-412e17ac-1669-4cff-a9dd-fa3a784a6f08-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (eb82dce3-e1d2-4a55-8df1-4ce80fbad1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248ce05-7780-47f7-9251-dbde61395226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248ce05-7780-47f7-9251-dbde61395226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205581051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4482c26a-e39f-4023-ae5e-367a4f895104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:49Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac113b9-ace9-4756-896f-4e0936d66200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac113b9-ace9-4756-896f-4e0936d66200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4db1c31-f1fc-47a7-842c-ae8a2766fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4db1c31-f1fc-47a7-842c-ae8a2766fee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4482c26a-e39f-4023-ae5e-367a4f895104', 'volume_name': 'volume-4482c26a-e39f-4023-ae5e-367a4f895104', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf4ec48-b297-4fa4-a99f-eff747086c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf4ec48-b297-4fa4-a99f-eff747086c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6bab37-ddbd-4e3b-a655-75236302e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:49 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Volume 4482c26a-e39f-4023-ae5e-367a4f895104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4482c26a-e39f-4023-ae5e-367a4f895104', 'volume_size': 1} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205581051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4482c26a-e39f-4023-ae5e-367a4f895104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:49Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Creating volume 4482c26a-e39f-4023-ae5e-367a4f895104 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:49 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:49 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 1073741824 Sep 01 01:47:49 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (f3951e50-53e9-4b14-baba-74836dacfc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a844dbee-0c93-4f2d-a553-1d139d761864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a844dbee-0c93-4f2d-a553-1d139d761864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359034481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dffbad-55a3-419b-b47a-259c552c478c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:50Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271df939-6949-43ab-bda7-9b5fc14a1b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271df939-6949-43ab-bda7-9b5fc14a1b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a4273b-bb7a-41f6-bda9-9affb389734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a4273b-bb7a-41f6-bda9-9affb389734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dffbad-55a3-419b-b47a-259c552c478c', 'volume_name': 'volume-f9dffbad-55a3-419b-b47a-259c552c478c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14663a7-f19e-4767-8069-557d92e47ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c14663a7-f19e-4767-8069-557d92e47ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe07cad-d56c-49bd-baad-f26d60245a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:50 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Volume f9dffbad-55a3-419b-b47a-259c552c478c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dffbad-55a3-419b-b47a-259c552c478c', 'volume_size': 1} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:50 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 1073741824" returned: 0 in 1.047s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:50 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 Sep 01 01:47:50 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (14f869ef-5e28-4adc-bafd-74b92a04b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd6be81-3dab-45d4-b333-c6645593e17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd6be81-3dab-45d4-b333-c6645593e17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346459623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28782601-08ef-4566-8057-29b8ceb8556e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:51Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbf3b8c-19cb-4c09-bc83-d72203634be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fbf3b8c-19cb-4c09-bc83-d72203634be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0f5d82-c54b-4b53-b5f6-5ce8da6961a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0f5d82-c54b-4b53-b5f6-5ce8da6961a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28782601-08ef-4566-8057-29b8ceb8556e', 'volume_name': 'volume-28782601-08ef-4566-8057-29b8ceb8556e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838655ec-15ad-4dad-9ae8-90dbfa4581eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838655ec-15ad-4dad-9ae8-90dbfa4581eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640e4d02-5f5d-4058-9613-d5c9e5b85c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Volume 28782601-08ef-4566-8057-29b8ceb8556e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28782601-08ef-4566-8057-29b8ceb8556e', 'volume_size': 1} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:51 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104" returned: 0 in 0.642s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359034481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dffbad-55a3-419b-b47a-259c552c478c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:50Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Creating volume f9dffbad-55a3-419b-b47a-259c552c478c {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:51 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:51 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c 1073741824 Sep 01 01:47:51 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6bab37-ddbd-4e3b-a655-75236302e214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4482c26a-e39f-4023-ae5e-367a4f895104', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36a207b-b55c-4f4d-a2df-2563da9533fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Volume volume-4482c26a-e39f-4023-ae5e-367a4f895104 (4482c26a-e39f-4023-ae5e-367a4f895104): created successfully Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36a207b-b55c-4f4d-a2df-2563da9533fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (eb82dce3-e1d2-4a55-8df1-4ce80fbad1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:51 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-089e89e1-ed32-42b5-aa43-439da0a4bd0e tempest-CreateVolumesFromImageTest-1881667588 None] Created volume successfully. Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (d35c00cc-bbd6-4df4-9f0b-ad92d44192c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332b6ef-b517-415d-a751-298cbd4c4bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332b6ef-b517-415d-a751-298cbd4c4bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1492495100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890c9ce5-7b66-49da-b2e7-5fac05a9f963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:52Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0551207c-722f-433b-abac-0cecb17ad335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0551207c-722f-433b-abac-0cecb17ad335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3b7c9-b311-4a8f-9acb-e8b68ee69ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed3b7c9-b311-4a8f-9acb-e8b68ee69ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890c9ce5-7b66-49da-b2e7-5fac05a9f963', 'volume_name': 'volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d2b45d-ff62-4608-9106-9b8a73e830d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d2b45d-ff62-4608-9106-9b8a73e830d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e5999c-6f2b-4e15-b3c9-8258bc1a3cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Volume 890c9ce5-7b66-49da-b2e7-5fac05a9f963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963', 'volume_size': 1} Sep 01 01:47:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (41928b7d-8c08-48c0-9ee9-073860f41ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f60fbf-fb84-4143-b9ed-b3b455b80cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f60fbf-fb84-4143-b9ed-b3b455b80cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637031184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d8ed54-7345-44cd-8953-8493fde8afd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:52Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94f0dd4-dcca-4d1d-b950-233b3caa05ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94f0dd4-dcca-4d1d-b950-233b3caa05ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bdae53-a718-44f8-aa08-9ee4ac0399c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bdae53-a718-44f8-aa08-9ee4ac0399c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d8ed54-7345-44cd-8953-8493fde8afd6', 'volume_name': 'volume-03d8ed54-7345-44cd-8953-8493fde8afd6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bb5891-78d1-4190-9a41-b757848b20ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bb5891-78d1-4190-9a41-b757848b20ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e526bd-31c5-4acf-94b9-481a7ce59047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Volume 03d8ed54-7345-44cd-8953-8493fde8afd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d8ed54-7345-44cd-8953-8493fde8afd6', 'volume_size': 1} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:52 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c 1073741824" returned: 0 in 0.978s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:52 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c Sep 01 01:47:52 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:53 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c" returned: 0 in 0.410s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346459623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28782601-08ef-4566-8057-29b8ceb8556e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:51Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Creating volume 28782601-08ef-4566-8057-29b8ceb8556e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:53 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe07cad-d56c-49bd-baad-f26d60245a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dffbad-55a3-419b-b47a-259c552c478c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:53 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e 1073741824 Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d347e90f-cfba-4ac9-9a2d-ea7c70fbedcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:53 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:53 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Volume volume-f9dffbad-55a3-419b-b47a-259c552c478c (f9dffbad-55a3-419b-b47a-259c552c478c): created successfully Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d347e90f-cfba-4ac9-9a2d-ea7c70fbedcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (f3951e50-53e9-4b14-baba-74836dacfc74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d6cf5264-3792-4fd0-951b-83faf2331df1 tempest-CreateVolumesFromImageTest-1881667588 None] Created volume successfully. Sep 01 01:47:53 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e 1073741824" returned: 0 in 0.873s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:54 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e Sep 01 01:47:54 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:54 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e" returned: 0 in 0.351s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.429s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1492495100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=890c9ce5-7b66-49da-b2e7-5fac05a9f963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:52Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Creating volume 890c9ce5-7b66-49da-b2e7-5fac05a9f963 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:54 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:54 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 1073741824 Sep 01 01:47:54 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640e4d02-5f5d-4058-9613-d5c9e5b85c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28782601-08ef-4566-8057-29b8ceb8556e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1767930-761e-4531-ab1f-b553428bb011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:54 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Volume volume-28782601-08ef-4566-8057-29b8ceb8556e (28782601-08ef-4566-8057-29b8ceb8556e): created successfully Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1767930-761e-4531-ab1f-b553428bb011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (14f869ef-5e28-4adc-bafd-74b92a04b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:54 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-56a5a6ce-d2cd-4112-9110-da009dc796d4 tempest-CreateVolumesFromImageTest-1881667588 None] Created volume successfully. Sep 01 01:47:55 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 1073741824" returned: 0 in 0.739s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:55 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 Sep 01 01:47:55 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:55 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.905s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637031184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d8ed54-7345-44cd-8953-8493fde8afd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23cce440877749509e385a2ab352723a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:52Z,use_quota=True,user_id='366f71bc6d58462cae2e89f45283de98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Creating volume 03d8ed54-7345-44cd-8953-8493fde8afd6 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:55 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:55 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 1073741824 Sep 01 01:47:55 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e5999c-6f2b-4e15-b3c9-8258bc1a3cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dd7ef7-86ed-4031-b9eb-fee4cf8c371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:55 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Volume volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 (890c9ce5-7b66-49da-b2e7-5fac05a9f963): created successfully Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dd7ef7-86ed-4031-b9eb-fee4cf8c371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (d35c00cc-bbd6-4df4-9f0b-ad92d44192c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:55 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-88a8c75e-454a-47c8-98be-e83528f33697 tempest-CreateVolumesFromImageTest-1881667588 None] Created volume successfully. Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Flow 'volume_create_manager' (9f75bbd1-cc9e-4ced-9d98-f00ab0a3bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:55 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a42512-4f9d-47c4-b057-5c78d3f2a994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a42512-4f9d-47c4-b057-5c78d3f2a994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-602395928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e957ccc8-1c2d-4aaa-978a-8b340e649540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68ea10c6c72471580f8e0a0f51611d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:56Z,use_quota=True,user_id='467a8fded19b4d4fbbfa9960e581540a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c12156-43e2-4d1c-9887-a98017fb14cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c12156-43e2-4d1c-9887-a98017fb14cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120d836c-b4d1-4b16-8e86-759f648ccb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120d836c-b4d1-4b16-8e86-759f648ccb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e957ccc8-1c2d-4aaa-978a-8b340e649540', 'volume_name': 'volume-e957ccc8-1c2d-4aaa-978a-8b340e649540', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930a5d7-e082-4c4f-ac85-08349ce4999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930a5d7-e082-4c4f-ac85-08349ce4999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d759e59-5da7-4a8f-a93c-2e04548e6bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Volume e957ccc8-1c2d-4aaa-978a-8b340e649540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e957ccc8-1c2d-4aaa-978a-8b340e649540', 'volume_size': 1} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:56 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 1073741824" returned: 0 in 0.836s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:56 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 Sep 01 01:47:56 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:56 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6" returned: 0 in 0.269s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-602395928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e957ccc8-1c2d-4aaa-978a-8b340e649540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e68ea10c6c72471580f8e0a0f51611d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:47:56Z,use_quota=True,user_id='467a8fded19b4d4fbbfa9960e581540a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Creating volume e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:47:56 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e526bd-31c5-4acf-94b9-481a7ce59047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d8ed54-7345-44cd-8953-8493fde8afd6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1494a8f-690b-4761-94ce-2ae60fa340ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:56 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 1073741824 Sep 01 01:47:56 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Volume volume-03d8ed54-7345-44cd-8953-8493fde8afd6 (03d8ed54-7345-44cd-8953-8493fde8afd6): created successfully Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1494a8f-690b-4761-94ce-2ae60fa340ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Flow 'volume_create_manager' (41928b7d-8c08-48c0-9ee9-073860f41ba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-44a9db83-2b6a-447a-8a7d-0fe3b40de37a tempest-CreateVolumesFromImageTest-1881667588 None] Created volume successfully. Sep 01 01:47:57 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 1073741824" returned: 0 in 0.620s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-03d8ed54-7345-44cd-8953-8493fde8afd6-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-03d8ed54-7345-44cd-8953-8493fde8afd6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:57 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 Sep 01 01:47:57 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-quobyte-03d8ed54-7345-44cd-8953-8493fde8afd6" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-03d8ed54-7345-44cd-8953-8493fde8afd6" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c793ad7-1752-47e8-8e90-b369ab10830d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:57 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 Sep 01 01:47:57 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:57 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540" returned: 0 in 0.379s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d759e59-5da7-4a8f-a93c-2e04548e6bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e957ccc8-1c2d-4aaa-978a-8b340e649540', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887856b1-1a67-49c4-8866-b00981c1e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:47:57 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Volume volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 (e957ccc8-1c2d-4aaa-978a-8b340e649540): created successfully Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887856b1-1a67-49c4-8866-b00981c1e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Flow 'volume_create_manager' (9f75bbd1-cc9e-4ced-9d98-f00ab0a3bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:47:57 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7a5029c1-fda1-47df-a666-911c55f8b622 tempest-SnapshotMetadataTestJSON-183710754 None] Created volume successfully. Sep 01 01:47:57 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6" returned: 0 in 0.408s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:57 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6 Sep 01 01:47:57 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:58 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-03d8ed54-7345-44cd-8953-8493fde8afd6" returned: 0 in 0.393s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-03d8ed54-7345-44cd-8953-8493fde8afd6" released by "delete_volume" :: held 0.859s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Creating offline snapshot 417e56ba-8bee-4a8a-bbea-13c50b7decfa of volume e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Created reservations ['c6dd9bc0-0aa7-48f5-ada0-423b557d27b5', '42d2a9b2-5773-482b-b81b-0eafb902f242', '60fea086-9c03-4f63-84c7-6b9888709e58', '64bfe8e0-658c-45ab-9501-29311e429489'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee916e-0691-4ce9-9380-0ab352d1d2e7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:58 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 Sep 01 01:47:58 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:58 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:58 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-890c9ce5-7b66-49da-b2e7-5fac05a9f963-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-890c9ce5-7b66-49da-b2e7-5fac05a9f963-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-quobyte-890c9ce5-7b66-49da-b2e7-5fac05a9f963" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-890c9ce5-7b66-49da-b2e7-5fac05a9f963" acquired by "delete_volume" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ebb62-6159-42b7-88f8-b8e5f8aaa2a7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:58 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:58 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540" returned: 0 in 0.566s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:58 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Deleted volume successfully. Sep 01 01:47:58 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa 1G Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e67758b2-76fc-490e-9449-e7276188fb7d tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-03d8ed54-7345-44cd-8953-8493fde8afd6-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:59 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:59 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 Sep 01 01:47:59 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:59 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963" returned: 0 in 0.512s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:59 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963 Sep 01 01:47:59 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:59 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa 1G" returned: 0 in 0.598s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:59 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa Sep 01 01:47:59 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:47:59 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-890c9ce5-7b66-49da-b2e7-5fac05a9f963" returned: 0 in 0.338s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-890c9ce5-7b66-49da-b2e7-5fac05a9f963" released by "delete_volume" :: held 0.927s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Created reservations ['28f587b8-a5c6-40e6-9b48-101849246b60', '92eecbbc-74e1-434a-aa57-f1cccd3508b5', '64cffc6f-6134-4a8d-ace1-be07cb2d0a4d', '32ceffef-9f0a-4d19-899c-e06a42acb7db'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:47:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:47:59 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:47:59 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:00 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa" returned: 0 in 0.457s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:00 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa is being set with open permissions: ugo+rw Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:00 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa Sep 01 01:48:00 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:00 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:00 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.412s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:00 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Deleted volume successfully. Sep 01 01:48:00 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.info Sep 01 01:48:00 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-872f0517-1a92-4676-ba1c-30b7fd3907f8 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-890c9ce5-7b66-49da-b2e7-5fac05a9f963-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:00 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.info" returned: 0 in 0.314s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:00 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.info is being set with open permissions: ugo+rw Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:00 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.info Sep 01 01:48:00 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:00 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-28782601-08ef-4566-8057-29b8ceb8556e-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.info" returned: 0 in 0.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-28782601-08ef-4566-8057-29b8ceb8556e-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3b53976c-0b82-4ead-95cc-f3a7950aee6e tempest-SnapshotMetadataTestJSON-183710754 None] Create snapshot completed successfully Sep 01 01:48:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-quobyte-28782601-08ef-4566-8057-29b8ceb8556e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-28782601-08ef-4566-8057-29b8ceb8556e" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:01 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8afcee2-6f48-4ba0-b6fa-d74cbc02a859]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:01 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e Sep 01 01:48:01 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:01 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e" returned: 0 in 0.484s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:01 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e Sep 01 01:48:01 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:02 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-28782601-08ef-4566-8057-29b8ceb8556e" returned: 0 in 0.449s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-28782601-08ef-4566-8057-29b8ceb8556e" released by "delete_volume" :: held 0.983s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Created reservations ['0ea76167-8764-46cc-809b-a2a1f3d0a8bc', '56d55dc2-9cff-4605-846b-7d01ed97d603', '3103276a-e8d1-4e74-bb84-75f105fdb28f', '35783ecb-6dcc-4ad7-9c45-16c9c179ac6b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:02 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:02 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "cinder-417e56ba-8bee-4a8a-bbea-13c50b7decfa-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-417e56ba-8bee-4a8a-bbea-13c50b7decfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "cinder-quobyte-e957ccc8-1c2d-4aaa-978a-8b340e649540" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-quobyte-e957ccc8-1c2d-4aaa-978a-8b340e649540" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "cinder-quobyte-417e56ba-8bee-4a8a-bbea-13c50b7decfa" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-quobyte-417e56ba-8bee-4a8a-bbea-13c50b7decfa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Deleting offline snapshot 417e56ba-8bee-4a8a-bbea-13c50b7decfa of volume e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] snapshot_file for this snap is: volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf412c45-6117-4fe8-b288-b860e537f395]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:02 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:02 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Deleted volume successfully. Sep 01 01:48:02 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa Sep 01 01:48:02 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b74a75e7-9998-46fd-b94f-584f131840ae tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-28782601-08ef-4566-8057-29b8ceb8556e-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:02 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa" returned: 0 in 0.424s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e957ccc8-1c2d-4aaa-978a-8b340e649540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ff609-b3f1-4f33-8eaa-160aacd4e3d4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:03 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 Sep 01 01:48:03 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-f9dffbad-55a3-419b-b47a-259c552c478c-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-f9dffbad-55a3-419b-b47a-259c552c478c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-quobyte-f9dffbad-55a3-419b-b47a-259c552c478c" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-f9dffbad-55a3-419b-b47a-259c552c478c" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f071c05-a474-4dfc-84be-f92e1b085bc6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:03 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540" returned: 0 in 0.468s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:03 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa Sep 01 01:48:03 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:03 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c Sep 01 01:48:03 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:03 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c" returned: 0 in 0.394s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:03 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c Sep 01 01:48:03 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:03 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa" returned: 0 in 0.371s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:03 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa Sep 01 01:48:03 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:04 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9dffbad-55a3-419b-b47a-259c552c478c" returned: 0 in 0.273s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:04 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540.417e56ba-8bee-4a8a-bbea-13c50b7decfa" returned: 0 in 0.254s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-f9dffbad-55a3-419b-b47a-259c552c478c" released by "delete_volume" :: held 0.731s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-quobyte-417e56ba-8bee-4a8a-bbea-13c50b7decfa" released by "_delete_snapshot" :: held 1.643s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-quobyte-e957ccc8-1c2d-4aaa-978a-8b340e649540" released by "delete_snapshot" :: held 1.669s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Created reservations ['96ca1062-8da0-4ac0-b47b-535694d052a0', 'e6e33446-07c8-40b6-817f-e8e91fc482a4', 'ffc37a95-da05-4ba2-b88e-fc24db32d237', 'd871b2ff-86f4-4a31-bc88-45dbd1ad9e76'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Created reservations ['8c95fecf-1282-4515-9a26-7b04e532a464', '99f09b08-9e7f-400c-aea9-bd2e14de30fe', '5f0ebc01-7917-433f-b287-cb2486256138', '03fc1419-b88c-44fe-9c86-17bc94ca4ce7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:04 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:04 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Delete snapshot completed successfully. Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c73e0e3e-76cc-48ad-86f3-de9bb65260e0 tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-417e56ba-8bee-4a8a-bbea-13c50b7decfa-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-4482c26a-e39f-4023-ae5e-367a4f895104-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-4482c26a-e39f-4023-ae5e-367a4f895104-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:04 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Deleted volume successfully. Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "cinder-quobyte-4482c26a-e39f-4023-ae5e-367a4f895104" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fbe114ec-4509-488c-a8ca-1095e80cfbbf tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-f9dffbad-55a3-419b-b47a-259c552c478c-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-4482c26a-e39f-4023-ae5e-367a4f895104" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb98bcd3-d591-4090-b85d-f4b001d8c2b8]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "cinder-e957ccc8-1c2d-4aaa-978a-8b340e649540-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-e957ccc8-1c2d-4aaa-978a-8b340e649540-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "cinder-quobyte-e957ccc8-1c2d-4aaa-978a-8b340e649540" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-quobyte-e957ccc8-1c2d-4aaa-978a-8b340e649540" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:04 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 Sep 01 01:48:04 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6c192-543d-46e5-a472-78acc144a83c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:04 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 Sep 01 01:48:04 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:05 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104" returned: 0 in 0.419s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:05 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104 Sep 01 01:48:05 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:05 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540" returned: 0 in 0.374s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:05 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540 Sep 01 01:48:05 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:05 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4482c26a-e39f-4023-ae5e-367a4f895104" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-quobyte-4482c26a-e39f-4023-ae5e-367a4f895104" released by "delete_volume" :: held 0.732s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Created reservations ['aded14b8-6a5e-4f39-86cd-8abb2c526971', '809eedac-6e03-4ced-9a3d-b49f61d78b1f', 'edb623c4-cd1f-46d7-be3c-aa57d25cd154', '4cc020d4-ff3b-4e70-bca4-74c1099f7db2'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:05 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e957ccc8-1c2d-4aaa-978a-8b340e649540" returned: 0 in 0.298s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:05 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:05 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-quobyte-e957ccc8-1c2d-4aaa-978a-8b340e649540" released by "delete_volume" :: held 0.735s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Created reservations ['9f3d19b2-cab1-4c56-8ded-1ea7ffa9576a', '89022956-f47e-4113-9d20-f71fde33ec51', '7289be9b-09c5-4a5f-aa00-45bc2c5a776f', 'c82f5830-d8d5-4cd2-948e-e152a4959b0b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:05 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:05 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:05 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.308s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Deleted volume successfully. Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c9467371-15c6-4514-baa8-6c44fda58d36 tempest-CreateVolumesFromImageTest-1881667588 None] Lock "cinder-4482c26a-e39f-4023-ae5e-367a4f895104-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:05 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:05 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Deleted volume successfully. Sep 01 01:48:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3f810bb9-56ba-49be-a07a-0ebb7796ac8d tempest-SnapshotMetadataTestJSON-183710754 None] Lock "cinder-e957ccc8-1c2d-4aaa-978a-8b340e649540-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:07 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Flow 'volume_create_manager' (c6c00dd7-ba0c-4cb2-bc7c-4faed97bdf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6ea0d1-4701-4d90-a93a-d21ee6776af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6ea0d1-4701-4d90-a93a-d21ee6776af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291885626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84ed30d-c5f2-4cad-a9d4-f302589765c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6615ef977dcf4ec1b509c46a4042b810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:08Z,use_quota=True,user_id='422088b82f9c4fd0a26671c6929b3829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a2dee-f49b-49e8-8fa3-14bfba39186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a2dee-f49b-49e8-8fa3-14bfba39186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbe3f55-cd2c-4914-a490-bda20f0a70b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbe3f55-cd2c-4914-a490-bda20f0a70b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84ed30d-c5f2-4cad-a9d4-f302589765c7', 'volume_name': 'volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb322c3-7a9b-4b2d-854f-8b035d9d5f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb322c3-7a9b-4b2d-854f-8b035d9d5f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26b11b5-e47c-4760-8f0f-95cc89d501cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:08 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Volume b84ed30d-c5f2-4cad-a9d4-f302589765c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7', 'volume_size': 1} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1291885626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84ed30d-c5f2-4cad-a9d4-f302589765c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6615ef977dcf4ec1b509c46a4042b810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:08Z,use_quota=True,user_id='422088b82f9c4fd0a26671c6929b3829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Creating volume b84ed30d-c5f2-4cad-a9d4-f302589765c7 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:08 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:08 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 1073741824 Sep 01 01:48:08 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:08 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 1073741824" returned: 0 in 0.565s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:08 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 Sep 01 01:48:08 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:09 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d26b11b5-e47c-4760-8f0f-95cc89d501cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f5b1f5-9a6c-497d-a7eb-38fd1280756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:09 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Volume volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 (b84ed30d-c5f2-4cad-a9d4-f302589765c7): created successfully Sep 01 01:48:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f5b1f5-9a6c-497d-a7eb-38fd1280756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Flow 'volume_create_manager' (c6c00dd7-ba0c-4cb2-bc7c-4faed97bdf15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3957aeea-1544-43e9-9ab5-d479fb72de41 tempest-ProjectReaderTests-597571051 None] Created volume successfully. Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Flow 'volume_create_manager' (4b474c9a-4063-40cb-b760-1fea523c11bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfa0ca1-5a69-4c07-bd80-12887d112ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfa0ca1-5a69-4c07-bd80-12887d112ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1099768402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6717c03f-b437-49b0-acd2-0873fb477807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f27625ef76f441382f88333e8218864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:10Z,use_quota=True,user_id='a070f98fa4de4687b8c60e32c0b6a399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0feb5638-e2b8-41b3-807e-38d1f46b2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0feb5638-e2b8-41b3-807e-38d1f46b2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6396a0b1-22fb-495b-95d5-24c775e022dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6396a0b1-22fb-495b-95d5-24c775e022dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6717c03f-b437-49b0-acd2-0873fb477807', 'volume_name': 'volume-6717c03f-b437-49b0-acd2-0873fb477807', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198cb96a-7c22-4ddd-85d4-d2b9b6f0095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198cb96a-7c22-4ddd-85d4-d2b9b6f0095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b1b899-71a7-4c32-87aa-182fd2159a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Volume 6717c03f-b437-49b0-acd2-0873fb477807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6717c03f-b437-49b0-acd2-0873fb477807', 'volume_size': 1} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1099768402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6717c03f-b437-49b0-acd2-0873fb477807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f27625ef76f441382f88333e8218864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:10Z,use_quota=True,user_id='a070f98fa4de4687b8c60e32c0b6a399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Creating volume 6717c03f-b437-49b0-acd2-0873fb477807 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:10 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:10 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 1073741824 Sep 01 01:48:10 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (2c774a19-ab14-4ae0-b380-64421e7bdcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05e674b-fad0-4dc5-ab6f-320903e2a5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Acquiring lock "cinder-b84ed30d-c5f2-4cad-a9d4-f302589765c7-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05e674b-fad0-4dc5-ab6f-320903e2a5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062878112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b730245-e671-4435-bb24-60e2722e71d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:10Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fdec7c-025d-4b21-bc27-bf4152c8375f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99fdec7c-025d-4b21-bc27-bf4152c8375f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007ced00-3c4d-4f62-ac43-64aebbca74c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007ced00-3c4d-4f62-ac43-64aebbca74c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b730245-e671-4435-bb24-60e2722e71d5', 'volume_name': 'volume-3b730245-e671-4435-bb24-60e2722e71d5', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e4751-c468-49ea-82a1-8436de8eacd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e4751-c468-49ea-82a1-8436de8eacd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204e9e67-d72c-4b98-a595-e1e960c7aa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume 3b730245-e671-4435-bb24-60e2722e71d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b730245-e671-4435-bb24-60e2722e71d5', 'volume_size': 1} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Lock "cinder-b84ed30d-c5f2-4cad-a9d4-f302589765c7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Acquiring lock "cinder-quobyte-b84ed30d-c5f2-4cad-a9d4-f302589765c7" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Lock "cinder-quobyte-b84ed30d-c5f2-4cad-a9d4-f302589765c7" acquired by "delete_volume" :: waited 0.012s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2163f03d-531b-4977-9ecf-d75dfcbd2182]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:10 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 Sep 01 01:48:10 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:10 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 1073741824" returned: 0 in 0.419s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:10 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 Sep 01 01:48:10 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:10 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7" returned: 0 in 0.375s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:10 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7 Sep 01 01:48:10 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:10 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062878112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b730245-e671-4435-bb24-60e2722e71d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:10Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Creating volume 3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:10 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b1b899-71a7-4c32-87aa-182fd2159a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6717c03f-b437-49b0-acd2-0873fb477807', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 1073741824 Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65609f86-f12c-4bc3-b597-70ea6e1e39a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:10 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Volume volume-6717c03f-b437-49b0-acd2-0873fb477807 (6717c03f-b437-49b0-acd2-0873fb477807): created successfully Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65609f86-f12c-4bc3-b597-70ea6e1e39a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Flow 'volume_create_manager' (4b474c9a-4063-40cb-b760-1fea523c11bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c2fb0683-72a1-4647-a402-fd52ede3efb3 tempest-VolumesMetadataTest-882456980 None] Created volume successfully. Sep 01 01:48:10 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b84ed30d-c5f2-4cad-a9d4-f302589765c7" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Lock "cinder-quobyte-b84ed30d-c5f2-4cad-a9d4-f302589765c7" released by "delete_volume" :: held 0.698s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Created reservations ['2e49018b-ec92-4a3e-aaf1-fced95a4c42a', 'd90e079b-5280-452a-9d45-6f5e40eabcd1', '216d3f42-2cde-45af-871d-bf57c3bdd19f', '60484ba1-8362-4a37-bc9f-d918fb088634'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:11 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:11 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:11 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 1073741824" returned: 0 in 0.531s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:11 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 Sep 01 01:48:11 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:11 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Deleted volume successfully. Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e98619d3-2efa-4210-bd48-d0af03a3d897 tempest-ProjectReaderTests-597571051 None] Lock "cinder-b84ed30d-c5f2-4cad-a9d4-f302589765c7-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:11 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204e9e67-d72c-4b98-a595-e1e960c7aa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b730245-e671-4435-bb24-60e2722e71d5', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630a1b72-cb8b-41ff-b80c-76d5786547fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=144,cinder:INSERT=42,cinder:UPDATE=184,cinder:DELETE=12 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:48:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume volume-3b730245-e671-4435-bb24-60e2722e71d5 (3b730245-e671-4435-bb24-60e2722e71d5): created successfully Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (630a1b72-cb8b-41ff-b80c-76d5786547fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (2c774a19-ab14-4ae0-b380-64421e7bdcff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bae81db4-8f6c-40dd-881d-888f21411e84 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created volume successfully. Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Flow 'volume_create_manager' (13e46dfd-bffd-4729-8bca-e896adc555fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cafa77-b4d9-4ee8-968c-f36a62073311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7cafa77-b4d9-4ee8-968c-f36a62073311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188947536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797e85ed-cb95-4839-bd15-ce4fd1898185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6615ef977dcf4ec1b509c46a4042b810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:12Z,use_quota=True,user_id='422088b82f9c4fd0a26671c6929b3829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6933ad-2fe9-461b-b423-392b627d36f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6933ad-2fe9-461b-b423-392b627d36f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d7ed0-d530-4d99-8311-4db28186fa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521d7ed0-d530-4d99-8311-4db28186fa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '797e85ed-cb95-4839-bd15-ce4fd1898185', 'volume_name': 'volume-797e85ed-cb95-4839-bd15-ce4fd1898185', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035b6207-c623-4a07-a8d9-d9e313222e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035b6207-c623-4a07-a8d9-d9e313222e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a8c370-5102-40e1-8e23-a9e58ec8f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Volume 797e85ed-cb95-4839-bd15-ce4fd1898185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-797e85ed-cb95-4839-bd15-ce4fd1898185', 'volume_size': 1} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188947536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797e85ed-cb95-4839-bd15-ce4fd1898185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6615ef977dcf4ec1b509c46a4042b810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:12Z,use_quota=True,user_id='422088b82f9c4fd0a26671c6929b3829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Creating volume 797e85ed-cb95-4839-bd15-ce4fd1898185 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:11 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:12 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 1073741824 Sep 01 01:48:12 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:12 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 1073741824" returned: 0 in 0.480s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=130,cinder:INSERT=38,cinder:UPDATE=169,cinder:DELETE=19 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:12 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 Sep 01 01:48:12 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Acquiring lock "cinder-6717c03f-b437-49b0-acd2-0873fb477807-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Lock "cinder-6717c03f-b437-49b0-acd2-0873fb477807-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:12 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185" returned: 0 in 0.257s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.487s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a8c370-5102-40e1-8e23-a9e58ec8f133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-797e85ed-cb95-4839-bd15-ce4fd1898185', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b036aeb-cc05-453f-8db7-6881af9c065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Creating offline snapshot 2cb9739e-5b04-43c1-baa9-1c9a605f88cd of volume 3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Acquiring lock "cinder-quobyte-6717c03f-b437-49b0-acd2-0873fb477807" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:12 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Volume volume-797e85ed-cb95-4839-bd15-ce4fd1898185 (797e85ed-cb95-4839-bd15-ce4fd1898185): created successfully Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b036aeb-cc05-453f-8db7-6881af9c065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Flow 'volume_create_manager' (13e46dfd-bffd-4729-8bca-e896adc555fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[475cdd9a-2b26-40a0-a900-904d1bd570ee]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Lock "cinder-quobyte-6717c03f-b437-49b0-acd2-0873fb477807" acquired by "delete_volume" :: waited 0.047s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-63829dec-3fe0-46bf-bdee-11586d1c765c tempest-ProjectReaderTests-597571051 None] Created volume successfully. Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ec6fe0-984d-48c5-8b70-fb6aa7fd320f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:12 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 Sep 01 01:48:12 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:12 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 Sep 01 01:48:12 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:13 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5" returned: 0 in 0.422s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:13 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd 1G Sep 01 01:48:13 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:13 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807" returned: 0 in 0.418s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:13 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807 Sep 01 01:48:13 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:13 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6717c03f-b437-49b0-acd2-0873fb477807" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Lock "cinder-quobyte-6717c03f-b437-49b0-acd2-0873fb477807" released by "delete_volume" :: held 0.749s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Created reservations ['90399576-79ba-4331-88da-593a8bccfc13', '8e37ba8d-d0e8-41f4-b660-8ba1dc2ca7e3', '3905eb9f-0584-4b5c-8aef-fc3ead800402', 'fa088479-2c27-40ce-a7f9-4c408c1571e2'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:13 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:13 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:13 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd 1G" returned: 0 in 0.542s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b730245-e671-4435-bb24-60e2722e71d5 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:13 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b730245-e671-4435-bb24-60e2722e71d5 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd Sep 01 01:48:13 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Flow 'volume_create_manager' (c5171a67-b754-46e3-9748-15c5b8a7ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5363d2-5c5f-4d1a-bb9c-e9b8c1fbd0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5363d2-5c5f-4d1a-bb9c-e9b8c1fbd0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-533362667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c5f111-e136-4181-9d89-a553345da129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50511ceba19749219a8f3f2092f7177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:14Z,use_quota=True,user_id='6fe3c2c1027c462bafc91e96186b52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ab7b98-9242-4a8f-a925-65a1b4aaee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ab7b98-9242-4a8f-a925-65a1b4aaee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cff367d-2d30-43da-9299-efb10b1b6a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cff367d-2d30-43da-9299-efb10b1b6a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c5f111-e136-4181-9d89-a553345da129', 'volume_name': 'volume-a1c5f111-e136-4181-9d89-a553345da129', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0114c54-fcf0-4fd0-8f22-c4f19235708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0114c54-fcf0-4fd0-8f22-c4f19235708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01f9d31-a08d-435f-b043-67f4ce8fac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:14 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Volume a1c5f111-e136-4181-9d89-a553345da129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c5f111-e136-4181-9d89-a553345da129', 'volume_size': 1} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Acquiring lock "cinder-797e85ed-cb95-4839-bd15-ce4fd1898185-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Lock "cinder-797e85ed-cb95-4839-bd15-ce4fd1898185-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:14 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.391s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Deleted volume successfully. Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Acquiring lock "cinder-quobyte-797e85ed-cb95-4839-bd15-ce4fd1898185" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0c26d0c5-fd29-4bcb-9587-895df5724577 tempest-VolumesMetadataTest-882456980 None] Lock "cinder-6717c03f-b437-49b0-acd2-0873fb477807-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Lock "cinder-quobyte-797e85ed-cb95-4839-bd15-ce4fd1898185" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:14 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b730245-e671-4435-bb24-60e2722e71d5 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd" returned: 0 in 0.404s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:14 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd is being set with open permissions: ugo+rw Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc939f9a-e1b5-4f5b-a01e-957fd78c2138]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:14 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd Sep 01 01:48:14 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:14 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 Sep 01 01:48:14 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:14 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd" returned: 0 in 0.263s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:14 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.info Sep 01 01:48:14 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:14 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:14 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185 Sep 01 01:48:14 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:14 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.info" returned: 0 in 0.319s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:14 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.info is being set with open permissions: ugo+rw Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:14 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.info Sep 01 01:48:14 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:14 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-797e85ed-cb95-4839-bd15-ce4fd1898185" returned: 0 in 0.298s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Lock "cinder-quobyte-797e85ed-cb95-4839-bd15-ce4fd1898185" released by "delete_volume" :: held 0.773s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Created reservations ['8ae2f68a-48e4-4e1e-a9fe-7ee1e384d8a8', 'eae5e8f2-5c1c-427f-b361-ff68b249e02d', 'e930b0e9-5dfc-452c-9afc-90f7943ae495', '98672718-7cfb-44fa-848e-03d67daedfc7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:15 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.info" returned: 0 in 0.292s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:15 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:15 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-533362667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c5f111-e136-4181-9d89-a553345da129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50511ceba19749219a8f3f2092f7177e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:14Z,use_quota=True,user_id='6fe3c2c1027c462bafc91e96186b52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Creating volume a1c5f111-e136-4181-9d89-a553345da129 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:15 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:15 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 1073741824 Sep 01 01:48:15 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7df5ec1d-c890-4076-8fd2-a5c8ab5ba042 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Create snapshot completed successfully Sep 01 01:48:15 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.325s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Deleted volume successfully. Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7eff335c-033a-4b2a-85df-98d808ef3d87 tempest-ProjectReaderTests-597571051 None] Lock "cinder-797e85ed-cb95-4839-bd15-ce4fd1898185-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:15 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 1073741824" returned: 0 in 0.674s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:15 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 Sep 01 01:48:15 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (a122a57c-7d90-4eea-8da9-70a3e17b7247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc0d1e-a73e-4d26-9246-25bf5813b742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bc0d1e-a73e-4d26-9246-25bf5813b742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1144362716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01b4ab6-d818-47d0-acdf-54f6cd355c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:16Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef76ac4-088b-4494-8fb7-bed8e69f7b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef76ac4-088b-4494-8fb7-bed8e69f7b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f2e42f-4b9d-4f51-9f7d-737fd1f26879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f2e42f-4b9d-4f51-9f7d-737fd1f26879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01b4ab6-d818-47d0-acdf-54f6cd355c63', 'volume_name': 'volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb53640c-8dd5-4900-891d-13e8203c8493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb53640c-8dd5-4900-891d-13e8203c8493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddab283-de4f-41b8-87df-a9a38b344914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume a01b4ab6-d818-47d0-acdf-54f6cd355c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63', 'volume_size': 1} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:16 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129" returned: 0 in 0.489s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.176s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1144362716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01b4ab6-d818-47d0-acdf-54f6cd355c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:16Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Creating volume a01b4ab6-d818-47d0-acdf-54f6cd355c63 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:16 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:16 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 1073741824 Sep 01 01:48:16 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01f9d31-a08d-435f-b043-67f4ce8fac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c5f111-e136-4181-9d89-a553345da129', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca49685-24ac-4da8-8155-e73844eaf2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Volume volume-a1c5f111-e136-4181-9d89-a553345da129 (a1c5f111-e136-4181-9d89-a553345da129): created successfully Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca49685-24ac-4da8-8155-e73844eaf2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Flow 'volume_create_manager' (c5171a67-b754-46e3-9748-15c5b8a7ffac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c5d3f3f4-c5c4-48d2-947e-1d1add7e14cd tempest-AttachVolumeNegativeTest-753336702 None] Created volume successfully. Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (91589f8a-6309-4a65-81f0-c6daa4a15adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdc8177-bacb-4e7f-bee3-b781fd5aa1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdc8177-bacb-4e7f-bee3-b781fd5aa1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892392499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22175aa-1e7f-4f78-a433-f8762cbbc42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:17Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6a3258-ecc7-4036-9032-09ef406077e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6a3258-ecc7-4036-9032-09ef406077e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f1c07d-e4ee-46fb-aa68-5c9110cb1636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f1c07d-e4ee-46fb-aa68-5c9110cb1636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c22175aa-1e7f-4f78-a433-f8762cbbc42e', 'volume_name': 'volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ff280b-142f-4fdc-933f-2c1dbc94989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ff280b-142f-4fdc-933f-2c1dbc94989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92ad1f6-0e6b-424e-a35e-ed573306157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume c22175aa-1e7f-4f78-a433-f8762cbbc42e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e', 'volume_size': 1} Sep 01 01:48:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:17 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 1073741824" returned: 0 in 0.696s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:17 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:17 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:17 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 Sep 01 01:48:17 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (e07ac035-e3aa-455d-a2a9-f0549b46e420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff86ef0f-ef1d-4c46-9bb7-953c0826d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff86ef0f-ef1d-4c46-9bb7-953c0826d208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005002571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddddb3b-3071-4a80-bccf-d5f3879d91ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:17Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27e3a3e-c77f-4639-b545-842a354b9fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27e3a3e-c77f-4639-b545-842a354b9fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9b0aba-e23c-4a85-9892-2e8ef75a967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a9b0aba-e23c-4a85-9892-2e8ef75a967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ddddb3b-3071-4a80-bccf-d5f3879d91ed', 'volume_name': 'volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5eb1b2-789e-442f-8694-5461df076775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5eb1b2-789e-442f-8694-5461df076775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400eef30-1aff-4fbd-94e1-d8ecd75b6f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:17 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume 5ddddb3b-3071-4a80-bccf-d5f3879d91ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed', 'volume_size': 1} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:17 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63" returned: 0 in 0.418s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1892392499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22175aa-1e7f-4f78-a433-f8762cbbc42e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:17Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Creating volume c22175aa-1e7f-4f78-a433-f8762cbbc42e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:17 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:17 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:17 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e 1073741824 Sep 01 01:48:17 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddab283-de4f-41b8-87df-a9a38b344914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092a7c8e-a7c1-4917-bf97-9792304f930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.658s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:48:17 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 (a01b4ab6-d818-47d0-acdf-54f6cd355c63): created successfully Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092a7c8e-a7c1-4917-bf97-9792304f930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (a122a57c-7d90-4eea-8da9-70a3e17b7247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9cc5b5d1-ddaa-4c09-919c-55124148e36a tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created volume successfully. Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (57c44e70-778b-4761-87f3-2bb93e1de72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0880946-8909-4589-8759-c281c099508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0880946-8909-4589-8759-c281c099508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-73097346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddc1436-22e6-4974-8669-3ca9afb8bdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:18Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f3463a-6b32-4942-bc71-5e68ca897a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f3463a-6b32-4942-bc71-5e68ca897a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449f29da-57fb-4e32-b4cd-bcc62a9278aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449f29da-57fb-4e32-b4cd-bcc62a9278aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ddc1436-22e6-4974-8669-3ca9afb8bdbf', 'volume_name': 'volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add76345-50b3-456d-879e-d1362c0fabad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add76345-50b3-456d-879e-d1362c0fabad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f4873a-3546-4b47-974a-a89b7edf771a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume 1ddc1436-22e6-4974-8669-3ca9afb8bdbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf', 'volume_size': 1} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-3b51e932-4d60-4512-a658-86ba6fd44c88 req-12305fa7-21e9-44d6-af63-f6dd6ffd24aa tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:18 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e 1073741824" returned: 0 in 0.967s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:18 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e Sep 01 01:48:18 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (3faffe85-ca51-433f-9c7f-0a6bdc5b0297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba44f0b-01c5-421d-8266-46817617e20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba44f0b-01c5-421d-8266-46817617e20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1253205560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484ad43a-d65c-4857-a44e-69eb09b67580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:19Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad212f7-969a-42b5-a38b-798817d78bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad212f7-969a-42b5-a38b-798817d78bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50307bf-ef7c-4def-9603-6d7246cbdbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50307bf-ef7c-4def-9603-6d7246cbdbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484ad43a-d65c-4857-a44e-69eb09b67580', 'volume_name': 'volume-484ad43a-d65c-4857-a44e-69eb09b67580', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56935a7-a141-4b93-aa14-b49f65c9b61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d56935a7-a141-4b93-aa14-b49f65c9b61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f7fdb3-42f1-4d56-aa49-7fefa7b881d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:18 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume 484ad43a-d65c-4857-a44e-69eb09b67580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484ad43a-d65c-4857-a44e-69eb09b67580', 'volume_size': 1} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:18 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e" returned: 0 in 0.327s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2005002571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddddb3b-3071-4a80-bccf-d5f3879d91ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:17Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Creating volume 5ddddb3b-3071-4a80-bccf-d5f3879d91ed {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:18 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92ad1f6-0e6b-424e-a35e-ed573306157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfc6244-ec35-4e44-9698-31d9b2aadd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:19 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed 1073741824 Sep 01 01:48:19 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:19 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e (c22175aa-1e7f-4f78-a433-f8762cbbc42e): created successfully Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfc6244-ec35-4e44-9698-31d9b2aadd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (91589f8a-6309-4a65-81f0-c6daa4a15adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:19 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b8cc4871-bf2e-40b2-9f61-67a391774b72 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created volume successfully. Sep 01 01:48:19 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed 1073741824" returned: 0 in 0.464s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:19 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed Sep 01 01:48:19 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:19 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed" returned: 0 in 0.273s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-73097346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddc1436-22e6-4974-8669-3ca9afb8bdbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:18Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Creating volume 1ddc1436-22e6-4974-8669-3ca9afb8bdbf {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:19 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:19 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf 1073741824 Sep 01 01:48:19 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400eef30-1aff-4fbd-94e1-d8ecd75b6f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f96f76a-11a8-49a7-bd27-46ad391ff062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:19 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed (5ddddb3b-3071-4a80-bccf-d5f3879d91ed): created successfully Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f96f76a-11a8-49a7-bd27-46ad391ff062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:19 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (e07ac035-e3aa-455d-a2a9-f0549b46e420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:19 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-be0e090e-c9f7-4813-b883-86ed0bf98c71 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created volume successfully. Sep 01 01:48:20 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf 1073741824" returned: 0 in 0.532s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:20 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf Sep 01 01:48:20 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:20 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Flow 'volume_create_manager' (44458883-a9da-40a3-9356-6a9ea6517c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3faab78-645f-4a17-8c1d-bff7fccac9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf" returned: 0 in 0.313s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-3b51e932-4d60-4512-a658-86ba6fd44c88 req-12305fa7-21e9-44d6-af63-f6dd6ffd24aa tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.148s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3faab78-645f-4a17-8c1d-bff7fccac9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-548438097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e522937-add0-474b-899a-2b344b2c87d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a9881492944516997e3059aece6cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:21Z,use_quota=True,user_id='7860fdbe9b3e428bb67eb9851b6e3c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a271c22-06db-4daa-8db6-114c043b2400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a271c22-06db-4daa-8db6-114c043b2400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d7dab-2dfe-4fd3-91ed-445ebec5d632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d7dab-2dfe-4fd3-91ed-445ebec5d632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e522937-add0-474b-899a-2b344b2c87d6', 'volume_name': 'volume-2e522937-add0-474b-899a-2b344b2c87d6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cc1fdb-750f-4f74-98cc-af8e9963898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cc1fdb-750f-4f74-98cc-af8e9963898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4523244-d428-48ee-9fed-d45a1dc71a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:20 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Volume 2e522937-add0-474b-899a-2b344b2c87d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e522937-add0-474b-899a-2b344b2c87d6', 'volume_size': 1} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f4873a-3546-4b47-974a-a89b7edf771a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5673f93c-91b7-4913-89b0-9b5b091aa644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-3b51e932-4d60-4512-a658-86ba6fd44c88 req-12305fa7-21e9-44d6-af63-f6dd6ffd24aa tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.081s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1253205560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484ad43a-d65c-4857-a44e-69eb09b67580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda12e2106d64b3c854d75006867053a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:19Z,use_quota=True,user_id='7892127bd9a94f839dea111101e847ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Creating volume 484ad43a-d65c-4857-a44e-69eb09b67580 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:20 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:20 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf (1ddc1436-22e6-4974-8669-3ca9afb8bdbf): created successfully Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5673f93c-91b7-4913-89b0-9b5b091aa644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:20 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 1073741824 Sep 01 01:48:20 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (57c44e70-778b-4761-87f3-2bb93e1de72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:20 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-20ba0ef4-764c-4a95-aa86-4bed7f6bc5ac tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created volume successfully. Sep 01 01:48:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-3b51e932-4d60-4512-a658-86ba6fd44c88 req-12305fa7-21e9-44d6-af63-f6dd6ffd24aa tempest-AttachVolumeNegativeTest-753336702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-a1c5f111-e136-4181-9d89-a553345da129', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f72d61a-07f0-4782-99bf-66b38664de39', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:48:20 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-3b51e932-4d60-4512-a658-86ba6fd44c88 req-12305fa7-21e9-44d6-af63-f6dd6ffd24aa tempest-AttachVolumeNegativeTest-753336702 None] attachment_update completed successfully. Sep 01 01:48:21 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 1073741824" returned: 0 in 0.620s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:21 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 Sep 01 01:48:21 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:21 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580" returned: 0 in 0.348s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-548438097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e522937-add0-474b-899a-2b344b2c87d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a9881492944516997e3059aece6cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:21Z,use_quota=True,user_id='7860fdbe9b3e428bb67eb9851b6e3c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Creating volume 2e522937-add0-474b-899a-2b344b2c87d6 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:21 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:21 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 1073741824 Sep 01 01:48:21 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f7fdb3-42f1-4d56-aa49-7fefa7b881d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484ad43a-d65c-4857-a44e-69eb09b67580', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f034dc-cf2f-470c-a5c5-a37930e60dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:21 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Volume volume-484ad43a-d65c-4857-a44e-69eb09b67580 (484ad43a-d65c-4857-a44e-69eb09b67580): created successfully Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f034dc-cf2f-470c-a5c5-a37930e60dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:21 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Flow 'volume_create_manager' (3faffe85-ca51-433f-9c7f-0a6bdc5b0297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f92b3fa4-c187-440e-bb84-807454d47ba4 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created volume successfully. Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-484ad43a-d65c-4857-a44e-69eb09b67580-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-484ad43a-d65c-4857-a44e-69eb09b67580-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-484ad43a-d65c-4857-a44e-69eb09b67580" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-484ad43a-d65c-4857-a44e-69eb09b67580" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb03b0-6201-464c-9c11-4ce2f137457f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:22 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 1073741824" returned: 0 in 0.554s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:22 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 Sep 01 01:48:22 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:22 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 Sep 01 01:48:22 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:22 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4523244-d428-48ee-9fed-d45a1dc71a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e522937-add0-474b-899a-2b344b2c87d6', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57becf68-8740-485a-baa7-7790ec8f5105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:22 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Volume volume-2e522937-add0-474b-899a-2b344b2c87d6 (2e522937-add0-474b-899a-2b344b2c87d6): created successfully Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57becf68-8740-485a-baa7-7790ec8f5105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Flow 'volume_create_manager' (44458883-a9da-40a3-9356-6a9ea6517c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:22 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580" returned: 0 in 0.423s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:22 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c333d7eb-589b-4b7e-88c6-74df5cc0130f tempest-VolumesTransfersV357Test-992217269 None] Created volume successfully. Sep 01 01:48:22 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580 Sep 01 01:48:22 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:23 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-484ad43a-d65c-4857-a44e-69eb09b67580" returned: 0 in 0.265s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-484ad43a-d65c-4857-a44e-69eb09b67580" released by "delete_volume" :: held 0.737s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created reservations ['a1fc1d79-e4b3-4eea-a37a-5bbb0004f973', '1d423ecf-a584-4d4f-b4a5-b0988c3c11d4', 'bfa1852e-d5a2-4f8d-99b2-c2079e5e93b3', '3a59afed-1b6e-4234-9464-cb92a040cc47'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:23 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:23 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-1ddc1436-22e6-4974-8669-3ca9afb8bdbf-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-1ddc1436-22e6-4974-8669-3ca9afb8bdbf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-1ddc1436-22e6-4974-8669-3ca9afb8bdbf" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-1ddc1436-22e6-4974-8669-3ca9afb8bdbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb17ded-6de3-4477-b255-b40fa0e6a3a2]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:23 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.385s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Deleted volume successfully. Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be1ae645-a231-40b0-af08-8261d9948762 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-484ad43a-d65c-4857-a44e-69eb09b67580-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:23 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf Sep 01 01:48:23 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-de7dd873-b58d-4a97-91d9-8a3b6633668d req-4fcff3cc-5eb6-4f11-aae3-45a44ef62cfd tempest-AttachVolumeNegativeTest-753336702 None] Terminate volume connection completed successfully. Sep 01 01:48:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-de7dd873-b58d-4a97-91d9-8a3b6633668d req-4fcff3cc-5eb6-4f11-aae3-45a44ef62cfd tempest-AttachVolumeNegativeTest-753336702 None] Deleting attachment 7f72d61a-07f0-4782-99bf-66b38664de39. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:48:24 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf" returned: 0 in 0.509s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:24 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf Sep 01 01:48:24 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:24 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ddc1436-22e6-4974-8669-3ca9afb8bdbf" returned: 0 in 0.275s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-1ddc1436-22e6-4974-8669-3ca9afb8bdbf" released by "delete_volume" :: held 0.831s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created reservations ['8d768ae8-b466-49f0-af46-d195833067cc', 'baf21549-1ade-4aa2-a39d-7bf6ed257750', '58f4a51d-8b6c-4919-ae49-6fa1c9fa80ab', 'fa05e323-34a3-419c-acd5-1cbefd890ee7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:24 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:24 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-5ddddb3b-3071-4a80-bccf-d5f3879d91ed-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-5ddddb3b-3071-4a80-bccf-d5f3879d91ed-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-5ddddb3b-3071-4a80-bccf-d5f3879d91ed" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-5ddddb3b-3071-4a80-bccf-d5f3879d91ed" acquired by "delete_volume" :: waited 0.066s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd91b11a-fe31-4569-ace7-dc358798ea75]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:25 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.454s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:25 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Deleted volume successfully. Sep 01 01:48:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-50c936ed-95d7-43f9-b1d5-5522b83163f7 tempest-VolumesTransfersV357Test-1352580728 None] Transfer volume completed successfully. Sep 01 01:48:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0028b92-a557-4487-9cc2-776f63074798 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-1ddc1436-22e6-4974-8669-3ca9afb8bdbf-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:25 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed Sep 01 01:48:25 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:25 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed" returned: 0 in 0.859s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:25 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed Sep 01 01:48:25 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:26 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5ddddb3b-3071-4a80-bccf-d5f3879d91ed" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-5ddddb3b-3071-4a80-bccf-d5f3879d91ed" released by "delete_volume" :: held 1.284s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created reservations ['713bddc4-209c-421c-ab64-daffe2b2e586', 'dd4a5f11-2a81-4d97-9b76-af4deb4da61c', 'ae89d022-a904-41f8-a0a9-2d987032f0b0', 'e6db6562-1dde-4dca-88a4-69b30b77e9b6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Acquiring lock "cinder-2e522937-add0-474b-899a-2b344b2c87d6-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-2e522937-add0-474b-899a-2b344b2c87d6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Acquiring lock "cinder-quobyte-2e522937-add0-474b-899a-2b344b2c87d6" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-quobyte-2e522937-add0-474b-899a-2b344b2c87d6" acquired by "delete_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c250f9-bbe0-4c5a-ba2c-99fac315bfe7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:26 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:26 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:26 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 Sep 01 01:48:26 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:27 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.559s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Deleted volume successfully. Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-59bdd7ec-199b-4ebc-8ad7-7327f8f5c2d9 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-5ddddb3b-3071-4a80-bccf-d5f3879d91ed-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:27 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6" returned: 0 in 0.632s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:27 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6 Sep 01 01:48:27 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-c22175aa-1e7f-4f78-a433-f8762cbbc42e-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-c22175aa-1e7f-4f78-a433-f8762cbbc42e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-c22175aa-1e7f-4f78-a433-f8762cbbc42e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-c22175aa-1e7f-4f78-a433-f8762cbbc42e" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61da86c-fc75-416d-963a-11be0507586e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:27 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e Sep 01 01:48:27 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:27 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2e522937-add0-474b-899a-2b344b2c87d6" returned: 0 in 0.516s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-quobyte-2e522937-add0-474b-899a-2b344b2c87d6" released by "delete_volume" :: held 1.227s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Created reservations ['cc66e26d-2424-43cf-a0f5-eece7046518f', '4493f5a6-6554-4905-9ac8-a3f9a4a60ac8', 'e3f93c04-cf0a-4cd0-a83c-23ac88e180fc', '603191df-320f-4475-8558-d77168035702'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:27 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:27 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:28 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e" returned: 0 in 0.700s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:28 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e Sep 01 01:48:28 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:28 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.389s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:28 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Deleted volume successfully. Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5bea7d7b-0c10-4751-a8f6-98fc01b0943a tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-2e522937-add0-474b-899a-2b344b2c87d6-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:28 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c22175aa-1e7f-4f78-a433-f8762cbbc42e" returned: 0 in 0.350s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-c22175aa-1e7f-4f78-a433-f8762cbbc42e" released by "delete_volume" :: held 1.130s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created reservations ['7e081ca7-a3b2-443e-bf91-791c2ccb81ce', 'ab03f200-3ca5-481f-9d6a-af43d8222e9a', '63ae4121-9588-4167-ab03-43d57fc53883', '43458b0e-5b75-4510-9944-7ab5b943e5e0'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:28 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:28 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:28 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.327s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:28 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Deleted volume successfully. Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (cd0a520e-e32b-4428-b473-1b111e864fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd65a0e9-c8d6-416c-973b-0416b03a343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd65a0e9-c8d6-416c-973b-0416b03a343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346638604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74125e4-edf0-433f-af1e-d14b4ab716e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:29Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e171eaf0-975e-4cc5-824a-4228cd306eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e171eaf0-975e-4cc5-824a-4228cd306eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40666d2-e748-4ab7-abff-b30346c4bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a40666d2-e748-4ab7-abff-b30346c4bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74125e4-edf0-433f-af1e-d14b4ab716e4', 'volume_name': 'volume-d74125e4-edf0-433f-af1e-d14b4ab716e4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c93bda-53ec-4e67-9eed-91ebc1166e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c93bda-53ec-4e67-9eed-91ebc1166e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dea64a5-6050-45e9-b1cf-72be97b0cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Volume d74125e4-edf0-433f-af1e-d14b4ab716e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74125e4-edf0-433f-af1e-d14b4ab716e4', 'volume_size': 1} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1346638604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74125e4-edf0-433f-af1e-d14b4ab716e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:29Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Creating volume d74125e4-edf0-433f-af1e-d14b4ab716e4 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:29 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a22c620a-5482-4f9e-b626-87d3e63b5e8c tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-c22175aa-1e7f-4f78-a433-f8762cbbc42e-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:29 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 1073741824 Sep 01 01:48:29 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Flow 'volume_create_manager' (c81d5571-dd4d-4cee-be5e-1e9669a67900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ac719a-35e7-4241-8011-b75e4f074aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ac719a-35e7-4241-8011-b75e4f074aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2090789793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6508e7-ff77-46df-9d17-0a0b6718a767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a9881492944516997e3059aece6cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:29Z,use_quota=True,user_id='7860fdbe9b3e428bb67eb9851b6e3c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965a3202-89d8-4883-9aaa-fe0adf4c6580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965a3202-89d8-4883-9aaa-fe0adf4c6580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3b6154-7985-4429-a3a4-1cbafae68cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3b6154-7985-4429-a3a4-1cbafae68cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6508e7-ff77-46df-9d17-0a0b6718a767', 'volume_name': 'volume-0b6508e7-ff77-46df-9d17-0a0b6718a767', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c7e2bf-21f8-441b-b1f5-2c4e33ec3ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c7e2bf-21f8-441b-b1f5-2c4e33ec3ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00740e59-1278-4e27-a472-aa95a6707ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Volume 0b6508e7-ff77-46df-9d17-0a0b6718a767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6508e7-ff77-46df-9d17-0a0b6718a767', 'volume_size': 1} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-a01b4ab6-d818-47d0-acdf-54f6cd355c63-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-a01b4ab6-d818-47d0-acdf-54f6cd355c63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-a01b4ab6-d818-47d0-acdf-54f6cd355c63" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-a01b4ab6-d818-47d0-acdf-54f6cd355c63" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:29 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 1073741824" returned: 0 in 0.573s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf440aef-1b27-4e6f-ad99-ca90944fabc5]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:29 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 Sep 01 01:48:29 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:29 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 Sep 01 01:48:29 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:29 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4" returned: 0 in 0.283s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2090789793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6508e7-ff77-46df-9d17-0a0b6718a767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a9881492944516997e3059aece6cb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:29Z,use_quota=True,user_id='7860fdbe9b3e428bb67eb9851b6e3c1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Creating volume 0b6508e7-ff77-46df-9d17-0a0b6718a767 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:29 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dea64a5-6050-45e9-b1cf-72be97b0cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74125e4-edf0-433f-af1e-d14b4ab716e4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:30 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 1073741824 Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062df56e-b12f-4a00-b2e7-ac11bc04d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:30 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:30 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Volume volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 (d74125e4-edf0-433f-af1e-d14b4ab716e4): created successfully Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062df56e-b12f-4a00-b2e7-ac11bc04d522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (cd0a520e-e32b-4428-b473-1b111e864fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f5553998-02db-4305-82dc-17f5261a1c5b tempest-ProjectReaderTests-588283847 None] Created volume successfully. Sep 01 01:48:30 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63 Sep 01 01:48:30 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "cinder-a1c5f111-e136-4181-9d89-a553345da129-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-a1c5f111-e136-4181-9d89-a553345da129-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "cinder-quobyte-a1c5f111-e136-4181-9d89-a553345da129" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-quobyte-a1c5f111-e136-4181-9d89-a553345da129" acquired by "delete_volume" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8365428c-9206-4d6a-83fd-f70d7be8f1f0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:30 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a01b4ab6-d818-47d0-acdf-54f6cd355c63" returned: 0 in 0.350s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-a01b4ab6-d818-47d0-acdf-54f6cd355c63" released by "delete_volume" :: held 0.814s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created reservations ['eed2b857-a456-4728-9c03-ee1e8cf0f93b', 'b9583300-fb0f-4764-9ecb-f0fa8b131705', '6afd895d-a9ea-4035-b018-3123a29dcdaf', 'bd4a4e52-b708-4ae0-a320-6fdd3a419bad'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:30 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 Sep 01 01:48:30 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:30 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 1073741824" returned: 0 in 0.594s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:30 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:30 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:30 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 Sep 01 01:48:30 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-2cb9739e-5b04-43c1-baa9-1c9a605f88cd-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-2cb9739e-5b04-43c1-baa9-1c9a605f88cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-3b730245-e671-4435-bb24-60e2722e71d5" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-3b730245-e671-4435-bb24-60e2722e71d5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-2cb9739e-5b04-43c1-baa9-1c9a605f88cd" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-2cb9739e-5b04-43c1-baa9-1c9a605f88cd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:30 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Deleting offline snapshot 2cb9739e-5b04-43c1-baa9-1c9a605f88cd of volume 3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:48:30 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] snapshot_file for this snap is: volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129" returned: 0 in 0.495s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.310s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a852e1-030c-406e-8f8e-45c2c2ead505]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:30 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129 Sep 01 01:48:30 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Deleted volume successfully. Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-01b74782-a1e2-464f-bb45-033adf3a40ee tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-a01b4ab6-d818-47d0-acdf-54f6cd355c63-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:30 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767" returned: 0 in 0.365s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00740e59-1278-4e27-a472-aa95a6707ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6508e7-ff77-46df-9d17-0a0b6718a767', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcf1c0b-9dee-441e-a10d-4527d007e1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:31 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Volume volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 (0b6508e7-ff77-46df-9d17-0a0b6718a767): created successfully Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcf1c0b-9dee-441e-a10d-4527d007e1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Flow 'volume_create_manager' (c81d5571-dd4d-4cee-be5e-1e9669a67900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:31 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd Sep 01 01:48:31 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4360d8dc-0ebf-47de-b3cb-ffa523b23e69 tempest-VolumesTransfersV357Test-992217269 None] Created volume successfully. Sep 01 01:48:31 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a1c5f111-e136-4181-9d89-a553345da129" returned: 0 in 0.324s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-quobyte-a1c5f111-e136-4181-9d89-a553345da129" released by "delete_volume" :: held 0.859s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-d74125e4-edf0-433f-af1e-d14b4ab716e4-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Lock "cinder-d74125e4-edf0-433f-af1e-d14b4ab716e4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Created reservations ['bf582f99-0552-45d8-933b-5261bc2eef70', '1cbac14f-27f7-4e98-b2cc-d11b9032e8a5', '7d5854bf-17ab-4a0b-b4c4-ecb4a0e0e851', 'cd6b0826-06e1-43b7-a38b-dcc2d87d11e9'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-quobyte-d74125e4-edf0-433f-af1e-d14b4ab716e4" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-d74125e4-edf0-433f-af1e-d14b4ab716e4" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:31 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd" returned: 0 in 0.482s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b730245-e671-4435-bb24-60e2722e71d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a970f4-fea4-4847-a0fc-b1d959e4964e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[03996fba-c181-45d8-8913-dfe796b86ed7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:31 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:31 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:31 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 Sep 01 01:48:31 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:31 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 Sep 01 01:48:31 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "cinder-f8200206-2279-4d78-8da1-f905db65c8c9-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-f8200206-2279-4d78-8da1-f905db65c8c9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "cinder-quobyte-f8200206-2279-4d78-8da1-f905db65c8c9" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-quobyte-f8200206-2279-4d78-8da1-f905db65c8c9" acquired by "delete_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d9900-4cca-41f0-8276-b2728f381ede]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Acquiring lock "cinder-0b6508e7-ff77-46df-9d17-0a0b6718a767-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-0b6508e7-ff77-46df-9d17-0a0b6718a767-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:32 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.487s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Deleted volume successfully. Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c5cc7358-9dc8-4596-bf47-db545f4bf455 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-a1c5f111-e136-4181-9d89-a553345da129-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Acquiring lock "cinder-quobyte-0b6508e7-ff77-46df-9d17-0a0b6718a767" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:32 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 Sep 01 01:48:32 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-quobyte-0b6508e7-ff77-46df-9d17-0a0b6718a767" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0146fd-8419-4b09-ad40-1caf0c06c21f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4" returned: 0 in 0.715s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5" returned: 0 in 0.729s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4 Sep 01 01:48:32 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd Sep 01 01:48:32 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 Sep 01 01:48:32 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9" returned: 0 in 0.513s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9 Sep 01 01:48:32 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d74125e4-edf0-433f-af1e-d14b4ab716e4" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-d74125e4-edf0-433f-af1e-d14b4ab716e4" released by "delete_volume" :: held 1.091s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Created reservations ['51df8bb5-3567-4a48-af81-d7f1c9b6c788', 'f356d4e2-31d6-4d3a-8d92-782fb753efee', '08ea6855-95d1-43d8-bf36-023b6014c36b', '1f9efe1b-1133-4231-9605-659a4bc35fdf'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:32 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767" returned: 0 in 0.518s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767 Sep 01 01:48:32 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd" returned: 0 in 0.515s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:32 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd Sep 01 01:48:32 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f8200206-2279-4d78-8da1-f905db65c8c9" returned: 0 in 0.332s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-quobyte-f8200206-2279-4d78-8da1-f905db65c8c9" released by "delete_volume" :: held 0.968s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:32 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:32 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Created reservations ['918ec70b-ebc9-4ad1-b2aa-f1be8e3eca34', 'e9472a24-5257-41d0-a221-797d4c971ec8', '18bc513a-cba6-43de-b02b-a38faa4137fe', 'defe3e06-1fcf-4e66-b071-7dc27f4e0617'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:32 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0b6508e7-ff77-46df-9d17-0a0b6718a767" returned: 0 in 0.311s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:32 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:32 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-quobyte-0b6508e7-ff77-46df-9d17-0a0b6718a767" released by "delete_volume" :: held 0.886s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:33 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.329s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:33 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Deleted volume successfully. Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5.2cb9739e-5b04-43c1-baa9-1c9a605f88cd" returned: 0 in 0.383s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Created reservations ['9a631b28-09ee-42b1-b1f0-71750375d8d4', '1333fa86-8498-43b7-9031-80b64617b8f6', '0ad0aa4a-59cd-4236-accf-6d32840fe427', '1bc93046-3f05-4b38-b55c-d04d8015d983'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3d784e02-6fa1-4393-b55f-0da49bb61816 tempest-ProjectReaderTests-588283847 None] Lock "cinder-d74125e4-edf0-433f-af1e-d14b4ab716e4-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-2cb9739e-5b04-43c1-baa9-1c9a605f88cd" released by "_delete_snapshot" :: held 2.294s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-3b730245-e671-4435-bb24-60e2722e71d5" released by "delete_snapshot" :: held 2.335s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:33 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:33 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:33 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.332s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Deleted volume successfully. Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created reservations ['40d0db92-b381-412a-b677-eeb9ab177d64', 'eff2c459-76dd-40a5-815d-e1b81b84159a', 'e0ebeb8d-c15d-44b5-a8fa-e837a2253325', '396f77e1-70fb-4aa1-97aa-f762e00c4fb8'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e6b53118-436a-444b-9c84-6809cea85dfe tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-f8200206-2279-4d78-8da1-f905db65c8c9-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Delete snapshot completed successfully. Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592b2061-c362-4a25-b7d2-cb88b903db80 tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-2cb9739e-5b04-43c1-baa9-1c9a605f88cd-delete_snapshot" released by "delete_snapshot" :: held 2.566s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:33 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.253s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Deleted volume successfully. Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e63938-2b91-45a8-93e7-d14db7391fdf tempest-VolumesTransfersV357Test-201300730 None] Lock "cinder-0b6508e7-ff77-46df-9d17-0a0b6718a767-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (ee5f402a-0357-4b39-ace4-7e81f47804da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5cc96a-fe2a-40ca-8dfa-59a5104bfb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5cc96a-fe2a-40ca-8dfa-59a5104bfb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-743050825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a90e3d2-451c-41c6-89a1-27131c7ad42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:34Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22862718-c2bc-4b58-be3d-ad3d5b80d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22862718-c2bc-4b58-be3d-ad3d5b80d24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506d07bf-2fc1-48bd-b891-dc22e2ed29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506d07bf-2fc1-48bd-b891-dc22e2ed29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a90e3d2-451c-41c6-89a1-27131c7ad42c', 'volume_name': 'volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99384ff-324e-41d4-a302-079156d5c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99384ff-324e-41d4-a302-079156d5c76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07368c57-2a19-4222-82b2-870f2f2bd825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:34 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Volume 4a90e3d2-451c-41c6-89a1-27131c7ad42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c', 'volume_size': 1} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-743050825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a90e3d2-451c-41c6-89a1-27131c7ad42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:34Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Creating volume 4a90e3d2-451c-41c6-89a1-27131c7ad42c {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:34 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:34 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c 1073741824 Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-3b730245-e671-4435-bb24-60e2722e71d5-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:34 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-3b730245-e671-4435-bb24-60e2722e71d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "cinder-quobyte-3b730245-e671-4435-bb24-60e2722e71d5" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-3b730245-e671-4435-bb24-60e2722e71d5" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "cinder-08b5720f-6389-4efd-8872-06bf327fef3e-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-08b5720f-6389-4efd-8872-06bf327fef3e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a687f72-e0ca-4d98-b478-4e70a25c1c9f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "cinder-quobyte-08b5720f-6389-4efd-8872-06bf327fef3e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-quobyte-08b5720f-6389-4efd-8872-06bf327fef3e" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db8e63-f92b-4c23-ab70-d9fbe96fe18d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:34 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 Sep 01 01:48:34 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:34 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e Sep 01 01:48:34 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:34 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c 1073741824" returned: 0 in 0.612s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:34 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5" returned: 0 in 0.430s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:34 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5 Sep 01 01:48:34 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:34 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c Sep 01 01:48:34 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:34 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e" returned: 0 in 0.454s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:34 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e Sep 01 01:48:34 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:34 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3b730245-e671-4435-bb24-60e2722e71d5" returned: 0 in 0.308s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-quobyte-3b730245-e671-4435-bb24-60e2722e71d5" released by "delete_volume" :: held 0.833s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:35 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c" returned: 0 in 0.312s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07368c57-2a19-4222-82b2-870f2f2bd825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8911cbfe-66f7-4a60-8200-7d9b69281599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:35 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Volume volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c (4a90e3d2-451c-41c6-89a1-27131c7ad42c): created successfully Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8911cbfe-66f7-4a60-8200-7d9b69281599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (ee5f402a-0357-4b39-ace4-7e81f47804da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8dcecc21-ffe4-4d0d-838c-512e1b6b81d9 tempest-ProjectReaderTests-588283847 None] Created volume successfully. Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Created reservations ['0457917c-dd4d-4759-8c30-f0bf0efd12e3', 'a0e5302f-b89f-4945-9d2c-253f4e07af94', '5df13519-923b-48f0-bf27-368b25fa8e49', '18fd51b3-225d-4f47-8006-ba1d9a1d5bbd'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:35 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08b5720f-6389-4efd-8872-06bf327fef3e" returned: 0 in 0.308s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-quobyte-08b5720f-6389-4efd-8872-06bf327fef3e" released by "delete_volume" :: held 0.816s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Created reservations ['58ee76dc-0f1e-4cbe-9bf7-0785faa4cfc4', '282176af-c56c-448e-a404-b087f6d19fbd', '942b57c4-9281-44a7-a713-b5c0c3e2b27f', 'b1d76bd8-0dac-4cc9-90b0-71d123d02021'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:35 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:35 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:35 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:35 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:35 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.329s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Deleted volume successfully. Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4c72e417-47ed-4aa3-b857-1d958722f7de tempest-CreateVolumesFromSnapshotTest-1049341883 None] Lock "cinder-3b730245-e671-4435-bb24-60e2722e71d5-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:35 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.358s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Deleted volume successfully. Sep 01 01:48:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a87d7752-5127-491b-a686-51c2db8e83c5 tempest-AttachVolumeNegativeTest-753336702 None] Lock "cinder-08b5720f-6389-4efd-8872-06bf327fef3e-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-4a90e3d2-451c-41c6-89a1-27131c7ad42c-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Lock "cinder-4a90e3d2-451c-41c6-89a1-27131c7ad42c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-quobyte-4a90e3d2-451c-41c6-89a1-27131c7ad42c" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-4a90e3d2-451c-41c6-89a1-27131c7ad42c" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7a817e-b0a3-4a47-b280-d3ab855130a7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:36 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c Sep 01 01:48:36 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:36 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c" returned: 0 in 0.447s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:36 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c Sep 01 01:48:36 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:37 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a90e3d2-451c-41c6-89a1-27131c7ad42c" returned: 0 in 0.277s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-4a90e3d2-451c-41c6-89a1-27131c7ad42c" released by "delete_volume" :: held 0.785s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Created reservations ['feac1a4c-ad0b-4ab0-8582-e43625f06185', '6e64f11e-2548-4589-87b1-02fe36db14ec', 'c36ac4c6-fd90-411a-9dba-4a3e0b779eb6', 'b40e7b4e-088f-4040-a214-3a34648f966b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:37 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:37 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:37 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.401s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:37 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Deleted volume successfully. Sep 01 01:48:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ddb4f565-692f-4d36-badd-237f4b07d53c tempest-ProjectReaderTests-588283847 None] Lock "cinder-4a90e3d2-451c-41c6-89a1-27131c7ad42c-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (aa5a906c-7bd5-4c11-9af6-2b20a2ac1ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b63f1f2-680f-4e80-a916-5043c120f9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b63f1f2-680f-4e80-a916-5043c120f9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350776690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f51fd32-bd75-4a82-9632-8b72d3d17508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:38Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f50fa24-5798-4f27-8c30-f8105eff9870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f50fa24-5798-4f27-8c30-f8105eff9870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0ec726-e997-4bf8-9870-2f59b7562e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0ec726-e997-4bf8-9870-2f59b7562e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f51fd32-bd75-4a82-9632-8b72d3d17508', 'volume_name': 'volume-3f51fd32-bd75-4a82-9632-8b72d3d17508', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98c506b-ad9d-4781-b98c-98caf050b23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98c506b-ad9d-4781-b98c-98caf050b23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63447350-c48a-46b8-be43-758c989b20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Volume 3f51fd32-bd75-4a82-9632-8b72d3d17508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f51fd32-bd75-4a82-9632-8b72d3d17508', 'volume_size': 1} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350776690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f51fd32-bd75-4a82-9632-8b72d3d17508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:38Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Creating volume 3f51fd32-bd75-4a82-9632-8b72d3d17508 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:38 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:38 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 1073741824 Sep 01 01:48:38 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:38 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 1073741824" returned: 0 in 0.585s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:39 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 Sep 01 01:48:39 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:39 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508" returned: 0 in 0.353s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63447350-c48a-46b8-be43-758c989b20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f51fd32-bd75-4a82-9632-8b72d3d17508', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8f53d0-9c3e-4228-91f0-02508128084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Volume volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 (3f51fd32-bd75-4a82-9632-8b72d3d17508): created successfully Sep 01 01:48:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8f53d0-9c3e-4228-91f0-02508128084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (aa5a906c-7bd5-4c11-9af6-2b20a2ac1ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2348c3b7-ca08-4270-8061-c30aa329e3bb tempest-ProjectReaderTests-588283847 None] Created volume successfully. Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-3f51fd32-bd75-4a82-9632-8b72d3d17508-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Lock "cinder-3f51fd32-bd75-4a82-9632-8b72d3d17508-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-quobyte-3f51fd32-bd75-4a82-9632-8b72d3d17508" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-3f51fd32-bd75-4a82-9632-8b72d3d17508" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[11564ca7-a7d1-48f4-9012-9c6de406b34d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:40 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 Sep 01 01:48:40 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:40 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508" returned: 0 in 0.424s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:41 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508 Sep 01 01:48:41 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:41 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-3f51fd32-bd75-4a82-9632-8b72d3d17508" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-3f51fd32-bd75-4a82-9632-8b72d3d17508" released by "delete_volume" :: held 0.935s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Created reservations ['198a78b7-add0-49b6-9ee0-b48fdd428c2f', '112812ec-902d-450f-9d1c-bd3c80b0bc6d', 'd5d4c975-1474-470d-949d-6d36d02cd8d7', 'faa4c905-a9ef-4c7d-9f64-a59b729694a9'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:41 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:41 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:41 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:41 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Deleted volume successfully. Sep 01 01:48:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-be855036-554a-4c39-bd61-859cd6a17135 tempest-ProjectReaderTests-588283847 None] Lock "cinder-3f51fd32-bd75-4a82-9632-8b72d3d17508-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (2520f87e-e10c-4d64-b817-d9b841841a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9d7d27-920c-4cdc-ab5d-04a1f2da42cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9d7d27-920c-4cdc-ab5d-04a1f2da42cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51826801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10643ed8-2f2e-44a0-bdc3-4ddfe12916e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:43Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e1d973-919b-4277-b8f6-38cb9f77cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e1d973-919b-4277-b8f6-38cb9f77cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0d059e-8163-422c-b361-202d4366190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0d059e-8163-422c-b361-202d4366190f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10643ed8-2f2e-44a0-bdc3-4ddfe12916e2', 'volume_name': 'volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5687fd-d9d1-4a11-91aa-12812343e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5687fd-d9d1-4a11-91aa-12812343e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccfe35b-727e-4610-aa1c-5ff538b2cbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Volume 10643ed8-2f2e-44a0-bdc3-4ddfe12916e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2', 'volume_size': 1} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51826801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10643ed8-2f2e-44a0-bdc3-4ddfe12916e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba893ed7c0d6431d9ab2a0d050c7283a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:43Z,use_quota=True,user_id='35884b8c972b4931ab4f4ab5888309de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Creating volume 10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:43 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:43 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 1073741824 Sep 01 01:48:43 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:44 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 1073741824" returned: 0 in 0.657s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:44 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 Sep 01 01:48:44 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:44 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2" returned: 0 in 0.394s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccfe35b-727e-4610-aa1c-5ff538b2cbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca66d0c-99c6-41aa-9c91-b8296955fe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:44 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Volume volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 (10643ed8-2f2e-44a0-bdc3-4ddfe12916e2): created successfully Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca66d0c-99c6-41aa-9c91-b8296955fe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Flow 'volume_create_manager' (2520f87e-e10c-4d64-b817-d9b841841a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-99525f49-48f5-42a3-a4e5-bdb90d37dbef tempest-ProjectReaderTests-588283847 None] Created volume successfully. Sep 01 01:48:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Lock "cinder-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Acquiring lock "cinder-quobyte-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeef350-ab32-4886-a16b-0335f822ae3d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:45 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 Sep 01 01:48:45 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Flow 'volume_create_manager' (2a8fc028-4c21-415f-ba4e-137b1dc93e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e684441-7a5f-45eb-a6d0-f71e00077f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e684441-7a5f-45eb-a6d0-f71e00077f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1604346506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f057e8-affd-4f16-8ad1-01df852ff14d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcfb354892a9417294f43aded6f25e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:46Z,use_quota=True,user_id='008f25e2fd6c47e38df31d8a153e2c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40687fca-79f2-4979-96b5-11c686239ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40687fca-79f2-4979-96b5-11c686239ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dcb9fe-b300-484f-bd4c-9ed3759854cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dcb9fe-b300-484f-bd4c-9ed3759854cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f057e8-affd-4f16-8ad1-01df852ff14d', 'volume_name': 'volume-d3f057e8-affd-4f16-8ad1-01df852ff14d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdaaba8-7f05-4d07-8e5f-9452e19878c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdaaba8-7f05-4d07-8e5f-9452e19878c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be108da-994d-4472-9310-e9f10f557d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:46 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Volume d3f057e8-affd-4f16-8ad1-01df852ff14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f057e8-affd-4f16-8ad1-01df852ff14d', 'volume_size': 1} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1604346506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f057e8-affd-4f16-8ad1-01df852ff14d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcfb354892a9417294f43aded6f25e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:46Z,use_quota=True,user_id='008f25e2fd6c47e38df31d8a153e2c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Creating volume d3f057e8-affd-4f16-8ad1-01df852ff14d {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:46 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:46 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2" returned: 0 in 0.470s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:46 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d 1073741824 Sep 01 01:48:46 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:46 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2 Sep 01 01:48:46 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:46 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Lock "cinder-quobyte-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2" released by "delete_volume" :: held 0.796s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Created reservations ['bb93a1a8-ec27-4a9e-bc69-560a84175674', '6934fa1c-79e5-4d01-a66d-bc0a0555b9b8', '139fa8b2-f108-415f-b52d-bebc5fe2e5e5', '3ec9fdae-caa4-4004-90c3-bf40a22be077'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:46 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:46 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:46 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d 1073741824" returned: 0 in 0.508s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:46 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d Sep 01 01:48:46 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:46 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.320s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:46 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Deleted volume successfully. Sep 01 01:48:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4136cb6f-9693-40ad-b2c9-4beebf524199 tempest-ProjectReaderTests-588283847 None] Lock "cinder-10643ed8-2f2e-44a0-bdc3-4ddfe12916e2-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:47 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d" returned: 0 in 0.349s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be108da-994d-4472-9310-e9f10f557d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f057e8-affd-4f16-8ad1-01df852ff14d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9a222e-87cb-41ff-9391-d624fdefe54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:47 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Volume volume-d3f057e8-affd-4f16-8ad1-01df852ff14d (d3f057e8-affd-4f16-8ad1-01df852ff14d): created successfully Sep 01 01:48:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9a222e-87cb-41ff-9391-d624fdefe54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Flow 'volume_create_manager' (2a8fc028-4c21-415f-ba4e-137b1dc93e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-4de3c24d-5502-4c55-8445-db68b24083ee req-ddcee41e-6b8e-4a92-81b7-f5e89b347b6d tempest-VolumesGetTestJSON-779025370 None] Created volume successfully. Sep 01 01:48:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Acquiring lock "cinder-d3f057e8-affd-4f16-8ad1-01df852ff14d-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Lock "cinder-d3f057e8-affd-4f16-8ad1-01df852ff14d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Acquiring lock "cinder-quobyte-d3f057e8-affd-4f16-8ad1-01df852ff14d" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:48:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Lock "cinder-quobyte-d3f057e8-affd-4f16-8ad1-01df852ff14d" acquired by "delete_volume" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:48:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[053591fd-75fe-4922-9f57-c4cc1946b7da]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:48:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:49 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d Sep 01 01:48:49 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:49 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d" returned: 0 in 0.396s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:49 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d Sep 01 01:48:49 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:49 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d3f057e8-affd-4f16-8ad1-01df852ff14d" returned: 0 in 0.275s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Lock "cinder-quobyte-d3f057e8-affd-4f16-8ad1-01df852ff14d" released by "delete_volume" :: held 0.722s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG cinder.quota [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Created reservations ['d072b6de-5121-4ee0-a943-e74d49b88ba4', 'e1e8ab99-10af-4d6c-882d-ae01c9ce1681', '255e2324-bb5e-4cac-b42d-b25bb7059cc8', '5e3c3dc7-0b19-4f1e-ac4c-7e6b71ad36b8'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:49 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:48:49 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:50 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.297s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:50 devstack cinder-volume[87212]: DEBUG cinder.manager [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:48:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Deleted volume successfully. Sep 01 01:48:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-85694f5b-e03f-401f-a8e7-f5012b1fd5a6 req-faea1199-42a7-4cd6-bc37-f6da41c55ece tempest-VolumesGetTestJSON-779025370 None] Lock "cinder-d3f057e8-affd-4f16-8ad1-01df852ff14d-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Flow 'volume_create_manager' (91a7b985-c1c4-4339-b9a5-295d45a152df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729bb295-0233-42cd-8b44-0f95942ee8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729bb295-0233-42cd-8b44-0f95942ee8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1374714366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286c04bc-74c8-4b16-8da5-a0cad5903e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45dfdee1802a4b80bf7b340e445cfaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:56Z,use_quota=True,user_id='d93a66029ec44f879fbf5e58a0a26bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a1dd79-8a29-4e50-80d4-1968bd4153e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a1dd79-8a29-4e50-80d4-1968bd4153e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0820612-9631-4e43-a0ea-41b402ea9b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0820612-9631-4e43-a0ea-41b402ea9b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286c04bc-74c8-4b16-8da5-a0cad5903e55', 'volume_name': 'volume-286c04bc-74c8-4b16-8da5-a0cad5903e55', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f491a3-129e-4fdd-9c54-1e94447fdffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f491a3-129e-4fdd-9c54-1e94447fdffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257a27e6-999a-43b0-af04-191779bbc093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:56 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Volume 286c04bc-74c8-4b16-8da5-a0cad5903e55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286c04bc-74c8-4b16-8da5-a0cad5903e55', 'volume_size': 1} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1374714366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286c04bc-74c8-4b16-8da5-a0cad5903e55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45dfdee1802a4b80bf7b340e445cfaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:48:56Z,use_quota=True,user_id='d93a66029ec44f879fbf5e58a0a26bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Creating volume 286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:48:56 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:48:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:56 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 1073741824 Sep 01 01:48:56 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:57 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 1073741824" returned: 0 in 0.542s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:48:57 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:48:57 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:48:57 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.284s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257a27e6-999a-43b0-af04-191779bbc093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286c04bc-74c8-4b16-8da5-a0cad5903e55', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c9ef42-9a08-42aa-8fd0-ea76afc8c24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:48:57 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Volume volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 (286c04bc-74c8-4b16-8da5-a0cad5903e55): created successfully Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7c9ef42-9a08-42aa-8fd0-ea76afc8c24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:48:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Flow 'volume_create_manager' (91a7b985-c1c4-4339-b9a5-295d45a152df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:48:57 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-08e6d3a2-6d0c-4763-b6d5-979b82300c66 tempest-VolumesActionsTest-1514745543 None] Created volume successfully. Sep 01 01:49:07 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=138,cinder:UPDATE=188,cinder:INSERT=49,cinder:DELETE=21 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:49:07 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=135,cinder:UPDATE=207,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:49:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-504bd332-1bbd-42a2-8753-93e6f90acd61 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55" by "attach_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-504bd332-1bbd-42a2-8753-93e6f90acd61 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55" acquired by "attach_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-504bd332-1bbd-42a2-8753-93e6f90acd61 tempest-VolumesActionsTest-1514745543 None] Attaching volume 286c04bc-74c8-4b16-8da5-a0cad5903e55 to instance 6b7b22d9-3eb6-4613-9c37-8f6f98201047 at mountpoint /dev/vdb on host None. Sep 01 01:49:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-504bd332-1bbd-42a2-8753-93e6f90acd61 tempest-VolumesActionsTest-1514745543 None] Attach volume completed successfully. Sep 01 01:49:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-504bd332-1bbd-42a2-8753-93e6f90acd61 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55" released by "attach_volume" :: held 0.131s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2b15f7-2365-4a78-b4a2-5c8dc40a2fc0 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-detach_volume" by "detach_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2b15f7-2365-4a78-b4a2-5c8dc40a2fc0 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6a2b15f7-2365-4a78-b4a2-5c8dc40a2fc0 tempest-VolumesActionsTest-1514745543 None] Detaching volume 286c04bc-74c8-4b16-8da5-a0cad5903e55 from instance 6b7b22d9-3eb6-4613-9c37-8f6f98201047. Sep 01 01:49:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6a2b15f7-2365-4a78-b4a2-5c8dc40a2fc0 tempest-VolumesActionsTest-1514745543 None] Detach volume completed successfully. Sep 01 01:49:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2b15f7-2365-4a78-b4a2-5c8dc40a2fc0 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Flow 'volume_create_manager' (bdd555a6-ab64-4f99-8928-9a940460db02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5884dc54-3132-4510-9b34-25cfa184b5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5884dc54-3132-4510-9b34-25cfa184b5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1931968039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acc6e88-0042-40fd-85e2-7fd6d9e57fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571da93e74f4c93a75fd5a063f6a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:11Z,use_quota=True,user_id='a12f0eca01c74429aedc56ade7a60dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab17efc-a4eb-46e5-ba09-32ea96c22f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab17efc-a4eb-46e5-ba09-32ea96c22f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12530cb0-fe20-4a7b-aa2d-8bf3a19cfc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12530cb0-fe20-4a7b-aa2d-8bf3a19cfc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2acc6e88-0042-40fd-85e2-7fd6d9e57fec', 'volume_name': 'volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1f8ca7-553e-443b-b463-9a9afc6eafd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1f8ca7-553e-443b-b463-9a9afc6eafd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785e7069-212f-4320-a23d-9b291d27f9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Volume 2acc6e88-0042-40fd-85e2-7fd6d9e57fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec', 'volume_size': 1} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1931968039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acc6e88-0042-40fd-85e2-7fd6d9e57fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571da93e74f4c93a75fd5a063f6a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:11Z,use_quota=True,user_id='a12f0eca01c74429aedc56ade7a60dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Creating volume 2acc6e88-0042-40fd-85e2-7fd6d9e57fec {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:49:11 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:11 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec 1073741824 Sep 01 01:49:11 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:11 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec 1073741824" returned: 0 in 0.520s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:11 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec Sep 01 01:49:11 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:12 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec" returned: 0 in 0.328s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:49:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785e7069-212f-4320-a23d-9b291d27f9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73123d2-7522-4118-ab21-41d8d4ba6b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:12 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Volume volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec (2acc6e88-0042-40fd-85e2-7fd6d9e57fec): created successfully Sep 01 01:49:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73123d2-7522-4118-ab21-41d8d4ba6b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Flow 'volume_create_manager' (bdd555a6-ab64-4f99-8928-9a940460db02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1683b01d-a3d8-44be-b6d7-3c652d61cbd9 tempest-VolumeQuotasAdminTestJSON-797816333 None] Created volume successfully. Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Acquiring lock "cinder-2acc6e88-0042-40fd-85e2-7fd6d9e57fec-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "cinder-2acc6e88-0042-40fd-85e2-7fd6d9e57fec-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Acquiring lock "cinder-quobyte-2acc6e88-0042-40fd-85e2-7fd6d9e57fec" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "cinder-quobyte-2acc6e88-0042-40fd-85e2-7fd6d9e57fec" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7194e70d-9916-4c0b-ac7e-dcbf87998623]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:13 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec Sep 01 01:49:13 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:13 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec" returned: 0 in 0.453s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:13 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec Sep 01 01:49:13 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:14 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2acc6e88-0042-40fd-85e2-7fd6d9e57fec" returned: 0 in 0.271s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "cinder-quobyte-2acc6e88-0042-40fd-85e2-7fd6d9e57fec" released by "delete_volume" :: held 0.775s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Created reservations ['92222ccb-312a-40c6-bcc0-ed0f4c423409', 'e9dc690f-49a0-4742-b25e-0f051f47ff2d', '0331ea0d-b6f4-4073-a4ef-6ca1ee047d3a', '36d7c9b5-e734-4918-9f89-002797c581b2'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:14 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:49:14 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:14 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.365s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:49:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Deleted volume successfully. Sep 01 01:49:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2befff47-2df2-4946-b81e-d099a3ffefaa tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "cinder-2acc6e88-0042-40fd-85e2-7fd6d9e57fec-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Flow 'volume_create_manager' (a0b9211f-75c4-413c-a4ab-782316d214d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ca2e77-6331-41c5-818a-d6e8fb920c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ca2e77-6331-41c5-818a-d6e8fb920c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143163780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33dffbd-2efa-4550-8dd3-74dfa4b3780f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571da93e74f4c93a75fd5a063f6a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:15Z,use_quota=True,user_id='a12f0eca01c74429aedc56ade7a60dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdbdfbc-d589-491e-87e6-ad95864dc145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdbdfbc-d589-491e-87e6-ad95864dc145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ca1a14-aeff-4faf-8e63-23cd7e636b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ca1a14-aeff-4faf-8e63-23cd7e636b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33dffbd-2efa-4550-8dd3-74dfa4b3780f', 'volume_name': 'volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7163878-c611-47f8-8866-c796348fb71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7163878-c611-47f8-8866-c796348fb71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ed526c-5e97-4b25-bf4b-fb2eb9d98cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:15 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Volume d33dffbd-2efa-4550-8dd3-74dfa4b3780f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f', 'volume_size': 1} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143163780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33dffbd-2efa-4550-8dd3-74dfa4b3780f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5571da93e74f4c93a75fd5a063f6a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:15Z,use_quota=True,user_id='a12f0eca01c74429aedc56ade7a60dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Creating volume d33dffbd-2efa-4550-8dd3-74dfa4b3780f {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:49:15 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:49:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:15 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f 1073741824 Sep 01 01:49:15 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:16 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f 1073741824" returned: 0 in 0.542s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:16 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f Sep 01 01:49:16 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:16 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ed526c-5e97-4b25-bf4b-fb2eb9d98cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821b5674-135f-4d1c-aa87-c949d8cc62e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Volume volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f (d33dffbd-2efa-4550-8dd3-74dfa4b3780f): created successfully Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821b5674-135f-4d1c-aa87-c949d8cc62e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Flow 'volume_create_manager' (a0b9211f-75c4-413c-a4ab-782316d214d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:16 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6b98671d-7d38-440b-ae4a-06b920c47293 tempest-VolumeQuotasAdminTestJSON-797816333 None] Created volume successfully. Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Flow 'volume_create_manager' (8a5ee895-6c99-4d55-9702-1c3404163102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d53c2d-1b12-4b31-921b-7b4e3cbf048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d53c2d-1b12-4b31-921b-7b4e3cbf048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-127429109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f936b29-005e-4b50-a2fc-0d93d9748015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9502794fa60d4b8c9444deeb1aa86fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:17Z,use_quota=True,user_id='2d30043363264564acb7d982e250e11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99092eaa-6cda-4802-8b81-8ca89c4237f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99092eaa-6cda-4802-8b81-8ca89c4237f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a8bcaf-ca94-4108-a1e9-320c2c341490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a8bcaf-ca94-4108-a1e9-320c2c341490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f936b29-005e-4b50-a2fc-0d93d9748015', 'volume_name': 'volume-0f936b29-005e-4b50-a2fc-0d93d9748015', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a919f4-1ca0-470d-90b2-f330028f6c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a919f4-1ca0-470d-90b2-f330028f6c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dbd0f9-4580-4c36-b4fe-71627cf117d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Volume 0f936b29-005e-4b50-a2fc-0d93d9748015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f936b29-005e-4b50-a2fc-0d93d9748015', 'volume_size': 1} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-127429109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f936b29-005e-4b50-a2fc-0d93d9748015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9502794fa60d4b8c9444deeb1aa86fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:17Z,use_quota=True,user_id='2d30043363264564acb7d982e250e11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Creating volume 0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:49:16 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:49:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:17 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 1073741824 Sep 01 01:49:17 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:17 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:49:17 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:17 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.288s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:49:17 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 1073741824" returned: 0 in 0.505s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:17 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 Sep 01 01:49:17 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:17 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dbd0f9-4580-4c36-b4fe-71627cf117d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f936b29-005e-4b50-a2fc-0d93d9748015', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf02dae-bc76-4099-94b1-7bb96e1a39d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:17 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Volume volume-0f936b29-005e-4b50-a2fc-0d93d9748015 (0f936b29-005e-4b50-a2fc-0d93d9748015): created successfully Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf02dae-bc76-4099-94b1-7bb96e1a39d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Flow 'volume_create_manager' (8a5ee895-6c99-4d55-9702-1c3404163102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cb307d0c-57e6-48d6-9449-0d76776eb48e tempest-SnapshotDependencyTests-969056641 None] Created volume successfully. Sep 01 01:49:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9498fb02-e79d-4330-a0df-360db4aa10ad tempest-VolumeQuotasAdminTestJSON-550002719 None] Transfer volume completed successfully. Sep 01 01:49:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Acquiring lock "cinder-d33dffbd-2efa-4550-8dd3-74dfa4b3780f-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Lock "cinder-d33dffbd-2efa-4550-8dd3-74dfa4b3780f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Acquiring lock "cinder-quobyte-d33dffbd-2efa-4550-8dd3-74dfa4b3780f" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Lock "cinder-quobyte-d33dffbd-2efa-4550-8dd3-74dfa4b3780f" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e783bdc-cb36-4c7c-abaa-28afa56b0975]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:18 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f Sep 01 01:49:18 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:19 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f" returned: 0 in 0.692s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:19 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f Sep 01 01:49:19 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Creating offline snapshot adda2f60-f576-4d1f-8c49-f58e033f78e2 of volume 0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[86427eb0-e518-4b29-a969-13ca60aa739b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:19 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 Sep 01 01:49:19 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:19 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d33dffbd-2efa-4550-8dd3-74dfa4b3780f" returned: 0 in 0.542s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Lock "cinder-quobyte-d33dffbd-2efa-4550-8dd3-74dfa4b3780f" released by "delete_volume" :: held 1.293s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Created reservations ['034f34f0-b62a-4a6c-88ed-e7ce580d8327', '7bc09fd5-12ac-4285-a0f3-003cfc2b7ec3', 'e1828e8b-885e-4d65-9893-14f8ab171c55', '80f3570b-ffa0-4ff1-953f-73b8a71b498a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:20 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:49:20 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:20 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015" returned: 0 in 0.549s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:20 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 1G Sep 01 01:49:20 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:20 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:49:20 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Deleted volume successfully. Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-38ce32bb-03fd-4e84-80db-2895b0ba2269 tempest-VolumeQuotasAdminTestJSON-336836841 None] Lock "cinder-d33dffbd-2efa-4550-8dd3-74dfa4b3780f-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:20 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 1G" returned: 0 in 0.511s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f936b29-005e-4b50-a2fc-0d93d9748015 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:20 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f936b29-005e-4b50-a2fc-0d93d9748015 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 Sep 01 01:49:20 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:20 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f936b29-005e-4b50-a2fc-0d93d9748015 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2" returned: 0 in 0.289s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:20 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 is being set with open permissions: ugo+rw Sep 01 01:49:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:20 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 Sep 01 01:49:20 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9503c390-ff82-46e0-8874-487542270755 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55" by "attach_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:21 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2" returned: 0 in 0.334s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9503c390-ff82-46e0-8874-487542270755 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55" acquired by "attach_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:21 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.info Sep 01 01:49:21 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9503c390-ff82-46e0-8874-487542270755 tempest-VolumesActionsTest-1514745543 None] Attaching volume 286c04bc-74c8-4b16-8da5-a0cad5903e55 to instance fdfd7652-dfb4-48d8-a257-72e4262155ec at mountpoint /dev/vdb on host None. Sep 01 01:49:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9503c390-ff82-46e0-8874-487542270755 tempest-VolumesActionsTest-1514745543 None] Attach volume completed successfully. Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9503c390-ff82-46e0-8874-487542270755 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55" released by "attach_volume" :: held 0.155s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:21 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.info" returned: 0 in 0.357s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:21 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.info is being set with open permissions: ugo+rw Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:21 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.info Sep 01 01:49:21 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29bf8d01-6f9d-49b1-b21a-1e41ddff3976 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-detach_volume" by "detach_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29bf8d01-6f9d-49b1-b21a-1e41ddff3976 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-29bf8d01-6f9d-49b1-b21a-1e41ddff3976 tempest-VolumesActionsTest-1514745543 None] Detaching volume 286c04bc-74c8-4b16-8da5-a0cad5903e55 from instance fdfd7652-dfb4-48d8-a257-72e4262155ec. Sep 01 01:49:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-29bf8d01-6f9d-49b1-b21a-1e41ddff3976 tempest-VolumesActionsTest-1514745543 None] Detach volume completed successfully. Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29bf8d01-6f9d-49b1-b21a-1e41ddff3976 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:21 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.info" returned: 0 in 0.276s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:22 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c361cac3-56fc-4412-a9b9-e134d4e5d8df tempest-SnapshotDependencyTests-969056641 None] Create snapshot completed successfully Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Flow 'volume_create_manager' (c3f97f25-ecda-46f1-9963-6e444dfa55ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a001d1-1117-4097-b825-76e3aeace1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a001d1-1117-4097-b825-76e3aeace1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9502794fa60d4b8c9444deeb1aa86fa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=adda2f60-f576-4d1f-8c49-f58e033f78e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:23Z,use_quota=True,user_id='2d30043363264564acb7d982e250e11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc497ff9-bf41-4221-a243-5dd38bce2889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc497ff9-bf41-4221-a243-5dd38bce2889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffda8eb5-dc05-4b94-abb5-b2296ab54b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffda8eb5-dc05-4b94-abb5-b2296ab54b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5', 'volume_name': 'volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5', 'volume_size': 1, 'snapshot_id': 'adda2f60-f576-4d1f-8c49-f58e033f78e2'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d641cc-1cf7-4ce5-a3d4-54fd09378a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14d641cc-1cf7-4ce5-a3d4-54fd09378a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab04538f-5c95-4f3b-baab-7d93763eb87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:23 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Volume 9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5', 'volume_size': 1, 'snapshot_id': 'adda2f60-f576-4d1f-8c49-f58e033f78e2'} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-quobyte-adda2f60-f576-4d1f-8c49-f58e033f78e2-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-adda2f60-f576-4d1f-8c49-f58e033f78e2-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Creating volume 9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 from snapshot adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-quobyte-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] snapshot: adda2f60-f576-4d1f-8c49-f58e033f78e2, volume: 9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e0ff2-f765-41d4-b6b6-b5213f5c6e7b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:23 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 Sep 01 01:49:23 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:24 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2" returned: 0 in 0.492s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f936b29-005e-4b50-a2fc-0d93d9748015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f682d1-885f-4a03-9569-b3ee05166d1d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:24 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 Sep 01 01:49:24 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:24 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015" returned: 0 in 0.444s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:49:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:24 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 Sep 01 01:49:24 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:29 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" returned: 0 in 4.988s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:29 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:49:29 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Converted 1024.00 MB image at 205.26 MB/s Sep 01 01:49:29 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 is being set with open permissions: ugo+rw Sep 01 01:49:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:29 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 Sep 01 01:49:29 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:30 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" returned: 0 in 0.254s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" released by "_copy_volume_from_snapshot" :: held 6.298s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-adda2f60-f576-4d1f-8c49-f58e033f78e2-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" released by "_create_volume_from_snapshot" :: held 6.371s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.390s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.963s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dce5209-04d7-4706-bcad-24ce6162656c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab04538f-5c95-4f3b-baab-7d93763eb87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5', 'volume_size': 1, 'snapshot_id': 'adda2f60-f576-4d1f-8c49-f58e033f78e2'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5f581c-c140-4a40-a2c8-f8a8f5a52d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Volume volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 (9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5): created successfully Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5f581c-c140-4a40-a2c8-f8a8f5a52d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Flow 'volume_create_manager' (c3f97f25-ecda-46f1-9963-6e444dfa55ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ad61c99a-33b4-41f2-8fda-e3265be7f540 tempest-SnapshotDependencyTests-969056641 None] Created volume successfully. Sep 01 01:49:30 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:49:30 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-adda2f60-f576-4d1f-8c49-f58e033f78e2-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-adda2f60-f576-4d1f-8c49-f58e033f78e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-quobyte-0f936b29-005e-4b50-a2fc-0d93d9748015" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-0f936b29-005e-4b50-a2fc-0d93d9748015" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-quobyte-adda2f60-f576-4d1f-8c49-f58e033f78e2" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-adda2f60-f576-4d1f-8c49-f58e033f78e2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Deleting offline snapshot adda2f60-f576-4d1f-8c49-f58e033f78e2 of volume 0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] snapshot_file for this snap is: volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c3039e-89cd-4bfe-aa41-690c0670f7c4]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:30 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.426s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f46b2-b6dc-42a0-a4c3-875cea767391]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:30 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 Sep 01 01:49:30 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:30 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:49:30 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:30 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2" returned: 0 in 0.389s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f936b29-005e-4b50-a2fc-0d93d9748015(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:49:30 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.390s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.230c7b8a-8fd0-44e6-973e-7548f75ec471bo8b2_pc.img {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1daa261-2fec-4112-b970-c4f20e846120]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:30 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.230c7b8a-8fd0-44e6-973e-7548f75ec471bo8b2_pc.img Sep 01 01:49:30 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:31 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 Sep 01 01:49:31 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:31 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015" returned: 0 in 0.788s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:31 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 Sep 01 01:49:31 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Flow 'volume_create_manager' (43a6ca36-0eec-4552-9e04-f9fde2846575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548ba359-5f60-490b-ac26-0621b37d15d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548ba359-5f60-490b-ac26-0621b37d15d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2041632305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780fe960-50c7-478f-95e8-a41df91b4d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53569b021c28489eabbf3916d5e36352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:32Z,use_quota=True,user_id='f49b96efbb2540829a96e229abd63f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6e2663-a62c-4c06-b106-4c71826dc9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6e2663-a62c-4c06-b106-4c71826dc9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d8398b-7b97-4fe0-9168-728bca5eeaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63d8398b-7b97-4fe0-9168-728bca5eeaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780fe960-50c7-478f-95e8-a41df91b4d3f', 'volume_name': 'volume-780fe960-50c7-478f-95e8-a41df91b4d3f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b803e0-5baa-4c40-b8e1-cca28a3fa365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b803e0-5baa-4c40-b8e1-cca28a3fa365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b16d8a7-b0b0-44f4-827b-4367d2a33a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Volume 780fe960-50c7-478f-95e8-a41df91b4d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780fe960-50c7-478f-95e8-a41df91b4d3f', 'volume_size': 1} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:32 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2" returned: 0 in 1.085s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:32 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2 Sep 01 01:49:32 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:33 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015.adda2f60-f576-4d1f-8c49-f58e033f78e2" returned: 0 in 0.475s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-adda2f60-f576-4d1f-8c49-f58e033f78e2" released by "_delete_snapshot" :: held 2.889s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-0f936b29-005e-4b50-a2fc-0d93d9748015" released by "delete_snapshot" :: held 2.925s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Created reservations ['3744eefe-5520-4e0c-8d8a-76aef446e494', '68164d30-41a9-4c2c-93f3-b62ad20519b2', '23f0ae84-1439-4d44-8935-6ce358d26473', 'a808280c-1150-4289-93e6-51bfedd463b7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:49:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Delete snapshot completed successfully. Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7184bef7-80cb-41cf-b514-82628ab574fe tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-adda2f60-f576-4d1f-8c49-f58e033f78e2-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-0f936b29-005e-4b50-a2fc-0d93d9748015-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-0f936b29-005e-4b50-a2fc-0d93d9748015-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-quobyte-0f936b29-005e-4b50-a2fc-0d93d9748015" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-0f936b29-005e-4b50-a2fc-0d93d9748015" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e77573f-e82e-4675-ae08-97359172a2e6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:34 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 Sep 01 01:49:34 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:35 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015" returned: 0 in 1.064s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:35 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015 Sep 01 01:49:35 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:35 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.230c7b8a-8fd0-44e6-973e-7548f75ec471bo8b2_pc.img" returned: 0 in 4.544s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0bf48f-3668-4574-96ab-ce53f19cdd6e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:35 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f936b29-005e-4b50-a2fc-0d93d9748015" returned: 0 in 0.363s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-0f936b29-005e-4b50-a2fc-0d93d9748015" released by "delete_volume" :: held 1.553s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Created reservations ['9009718c-f1ad-4825-a186-b0da52f3c264', '17bf2344-33c8-4e6a-a90c-20ae343b0022', 'ebd1f46c-3264-4a73-956d-8fc7506b630d', 'efa4c80a-c2ed-412a-887b-bb9a4a0fccb7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:49:35 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:49:35 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:35 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:49:35 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:35 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.257s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:49:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Deleted volume successfully. Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99a7a7ef-835d-4280-ab88-2c393d2ad893 tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-0f936b29-005e-4b50-a2fc-0d93d9748015-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:35 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.510s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:35 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.230c7b8a-8fd0-44e6-973e-7548f75ec471bo8b2_pc.img {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:49:35 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Converted 1024.00 MB image at 225.27 MB/s Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] 230c7b8a-8fd0-44e6-973e-7548f75ec471 was raw, no need to convert to raw {{(pid=87212) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "cinder-quobyte-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd2036-6c78-4325-a2ad-833160aa7ffb]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:36 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 Sep 01 01:49:36 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:36 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" returned: 0 in 0.357s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:36 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5 Sep 01 01:49:36 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:37 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" returned: 0 in 0.263s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-quobyte-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5" released by "delete_volume" :: held 0.669s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Created reservations ['cd7845bb-4bdd-423b-9bc8-d8b9d5e30165', '774ebbaf-8fad-4920-adbe-a2a96b26bce5', 'cd4b62b8-5056-42c7-99e7-32daf24ab59c', 'b4bb8c42-7072-4626-aaa7-74be9f9b22a7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:37 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:49:37 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:37 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.263s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:49:37 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Deleted volume successfully. Sep 01 01:49:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f5114207-6cc9-497f-a315-7e160f332a9c tempest-SnapshotDependencyTests-969056641 None] Lock "cinder-9e4b6e7d-0c3a-480d-9e53-dfc3f802b3c5-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:47 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=55,cinder:UPDATE=55,cinder:DELETE=3,cinder:INSERT=13 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:49:47 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:INSERT=16,cinder:SELECT=54,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.346s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Uploaded volume to glance image-id: 230c7b8a-8fd0-44e6-973e-7548f75ec471. {{(pid=87212) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.759s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2041632305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780fe960-50c7-478f-95e8-a41df91b4d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53569b021c28489eabbf3916d5e36352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:49:32Z,use_quota=True,user_id='f49b96efbb2540829a96e229abd63f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Creating volume 780fe960-50c7-478f-95e8-a41df91b4d3f {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:49:56 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:56 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f 1073741824 Sep 01 01:49:56 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:56 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-91fce14d-07ec-4d66-b311-2e501e756ebb tempest-VolumesActionsTest-1514745543 None] Copy volume to image completed successfully. Sep 01 01:49:56 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f 1073741824" returned: 0 in 0.422s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:56 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f Sep 01 01:49:56 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:57 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f" returned: 0 in 0.270s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b16d8a7-b0b0-44f4-827b-4367d2a33a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780fe960-50c7-478f-95e8-a41df91b4d3f', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8a01cb-cc1b-4516-a60b-5e7ef3793a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:49:57 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Volume volume-780fe960-50c7-478f-95e8-a41df91b4d3f (780fe960-50c7-478f-95e8-a41df91b4d3f): created successfully Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed8a01cb-cc1b-4516-a60b-5e7ef3793a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Flow 'volume_create_manager' (43a6ca36-0eec-4552-9e04-f9fde2846575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:49:57 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6bf2b941-b3d4-4093-9047-0e713f8938b5 tempest-VolumesServicesTestJSON-1273544220 None] Created volume successfully. Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Acquiring lock "cinder-780fe960-50c7-478f-95e8-a41df91b4d3f-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Lock "cinder-780fe960-50c7-478f-95e8-a41df91b4d3f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Acquiring lock "cinder-quobyte-780fe960-50c7-478f-95e8-a41df91b4d3f" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Lock "cinder-quobyte-780fe960-50c7-478f-95e8-a41df91b4d3f" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d42b3c-a2e8-487c-9aab-6b25995c92de]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:57 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f Sep 01 01:49:57 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:58 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f" returned: 0 in 0.401s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:58 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f Sep 01 01:49:58 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:58 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-780fe960-50c7-478f-95e8-a41df91b4d3f" returned: 0 in 0.253s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Lock "cinder-quobyte-780fe960-50c7-478f-95e8-a41df91b4d3f" released by "delete_volume" :: held 0.697s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b95379-ce96-401f-b71e-1b7ae697c367]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Created reservations ['1a14d593-4a45-473e-86ea-ae8649590f46', '0e71a058-4b5e-46cb-a209-54935258c879', 'e5c2d977-87e5-4f74-9080-1fb1fadfad4c', 'f40465d8-bf10-48da-af3a-c8fb608b0c73'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:49:58 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:49:58 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:58 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:49:58 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:58 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:58 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.392s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.274s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:49:58 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Deleted volume successfully. Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fba156-2666-4fdc-b23f-ddc539e9bc26]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9bcac2a-9e4c-480b-9bf2-bbc52d67886a tempest-VolumesServicesTestJSON-1273544220 None] Lock "cinder-780fe960-50c7-478f-95e8-a41df91b4d3f-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:49:58 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:49:58 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:49:59 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 01 01:49:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.387s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:49:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:49:59 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img Sep 01 01:49:59 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:03 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img" returned: 0 in 4.709s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:03 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a37544-3a73-4fe5-b8dd-afefb6f31c25]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:04 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:50:04 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:04 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.554s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:04 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:50:04 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Converted 1024.00 MB image at 217.38 MB/s Sep 01 01:50:04 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] 990d5ec3-3110-48db-92fa-f8704401ecca was raw, converting to qcow2 {{(pid=87212) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 01:50:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d56f19-1f3e-4268-be0c-55cfc93312e8]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:04 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img Sep 01 01:50:04 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:04 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img" returned: 0 in 0.338s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:04 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img Sep 01 01:50:04 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:05 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img" returned: 1 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img /opt/stack/data/cinder/conversion/vol_upload_9x7bnp34 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:05 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img /opt/stack/data/cinder/conversion/vol_upload_9x7bnp34 Sep 01 01:50:05 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:05 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img /opt/stack/data/cinder/conversion/vol_upload_9x7bnp34" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Image conversion details: src /opt/stack/data/cinder/conversion/286c04bc-74c8-4b16-8da5-a0cad5903e55.temp_image.990d5ec3-3110-48db-92fa-f8704401eccaslr0an10.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9x7bnp34 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:50:05 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e44dab-084e-4c9f-ab7d-b781ae807ccc]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9x7bnp34 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:05 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9x7bnp34 Sep 01 01:50:05 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:05 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9x7bnp34" returned: 0 in 0.332s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.034s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Uploaded volume to glance image-id: 990d5ec3-3110-48db-92fa-f8704401ecca. {{(pid=87212) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 01:50:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c4d47d0f-5c92-4a17-8aa9-c767cd3bcaf0 tempest-VolumesActionsTest-1514745543 None] Copy volume to image completed successfully. Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Flow 'volume_create_manager' (4cd978e7-24be-4929-b78d-3b47d95d3f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7d6c71-84af-4c62-a3be-541861c95a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7d6c71-84af-4c62-a3be-541861c95a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1778616103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc807310-207c-4bdb-b91b-098ed27e651d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0293126895824400bed2e7713848347e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:08Z,use_quota=True,user_id='f2ec36bd25c7446ca77f82eb5cec5105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f88bf316-20c6-439c-9989-4840a8f2abd5),volume_type_id=f88bf316-20c6-439c-9989-4840a8f2abd5)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac15dc-8871-4f2f-956a-1d3e98e16740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ac15dc-8871-4f2f-956a-1d3e98e16740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f106541-b4eb-4751-b65b-6fd756e8074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f106541-b4eb-4751-b65b-6fd756e8074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc807310-207c-4bdb-b91b-098ed27e651d', 'volume_name': 'volume-cc807310-207c-4bdb-b91b-098ed27e651d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f17afca-4153-4ce6-bff4-fb332a9e6bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f17afca-4153-4ce6-bff4-fb332a9e6bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594d31aa-5477-4182-9888-115a066eec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:07 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Volume cc807310-207c-4bdb-b91b-098ed27e651d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc807310-207c-4bdb-b91b-098ed27e651d', 'volume_size': 1} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1778616103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc807310-207c-4bdb-b91b-098ed27e651d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0293126895824400bed2e7713848347e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:08Z,use_quota=True,user_id='f2ec36bd25c7446ca77f82eb5cec5105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f88bf316-20c6-439c-9989-4840a8f2abd5),volume_type_id=f88bf316-20c6-439c-9989-4840a8f2abd5)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Creating volume cc807310-207c-4bdb-b91b-098ed27e651d {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:50:07 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:50:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:07 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d 1073741824 Sep 01 01:50:07 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:08 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d 1073741824" returned: 0 in 0.503s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:08 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d Sep 01 01:50:08 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:08 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594d31aa-5477-4182-9888-115a066eec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc807310-207c-4bdb-b91b-098ed27e651d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3109c8c-04e0-494f-a9e4-6a983e52ac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:08 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Volume volume-cc807310-207c-4bdb-b91b-098ed27e651d (cc807310-207c-4bdb-b91b-098ed27e651d): created successfully Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3109c8c-04e0-494f-a9e4-6a983e52ac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Flow 'volume_create_manager' (4cd978e7-24be-4929-b78d-3b47d95d3f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4cdbb7e2-76fa-4147-bd95-69779c18c821 tempest-VolumeTypesAccessTest-17564184 None] Created volume successfully. Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "cinder-quobyte-286c04bc-74c8-4b16-8da5-a0cad5903e55" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-quobyte-286c04bc-74c8-4b16-8da5-a0cad5903e55" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b33480-80fc-4410-8ef5-d28bf9e36fa8]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:08 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:50:08 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:09 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.373s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:09 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55 Sep 01 01:50:09 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:09 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-286c04bc-74c8-4b16-8da5-a0cad5903e55" returned: 0 in 0.248s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-quobyte-286c04bc-74c8-4b16-8da5-a0cad5903e55" released by "delete_volume" :: held 0.655s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Created reservations ['32ad2b86-14d2-42f7-9dbb-57301eb0273b', '46eb49ed-2e1a-4617-a3e4-61990ffef5ef', 'e48a92ce-346e-45f7-9f73-a6ec70fc23f0', '02ef2770-4486-4a8a-8a18-5e1a53402ef4'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:09 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:50:09 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:09 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:50:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Deleted volume successfully. Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Acquiring lock "cinder-cc807310-207c-4bdb-b91b-098ed27e651d-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b76d002a-53cd-4487-a8e3-21532022dd91 tempest-VolumesActionsTest-1514745543 None] Lock "cinder-286c04bc-74c8-4b16-8da5-a0cad5903e55-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Lock "cinder-cc807310-207c-4bdb-b91b-098ed27e651d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Acquiring lock "cinder-quobyte-cc807310-207c-4bdb-b91b-098ed27e651d" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Lock "cinder-quobyte-cc807310-207c-4bdb-b91b-098ed27e651d" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed0953e-261b-4fbc-8012-b4cee5b16d46]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:10 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d Sep 01 01:50:10 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:10 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:10 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d Sep 01 01:50:10 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:10 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc807310-207c-4bdb-b91b-098ed27e651d" returned: 0 in 0.258s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Lock "cinder-quobyte-cc807310-207c-4bdb-b91b-098ed27e651d" released by "delete_volume" :: held 0.667s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:10 devstack cinder-volume[87212]: WARNING cinder.quota [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1532353822 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1532353822, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:50:10 devstack cinder-volume[87212]: WARNING cinder.quota [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1532353822 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1532353822, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Created reservations ['5e2238d5-14f0-4eae-aac2-70983e50580c', 'f665465e-44a7-4550-b1a2-e9893d68e778', '9b0584b9-11ce-46ad-8f70-6954249f7035', 'a1498115-bdf3-4ec9-9162-ceb01d61f2a6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:10 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:50:10 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:10 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:10 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:50:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Deleted volume successfully. Sep 01 01:50:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3387617f-6b22-41c0-83d1-bbeac9d22eff tempest-VolumeTypesAccessTest-17564184 None] Lock "cinder-cc807310-207c-4bdb-b91b-098ed27e651d-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:17 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:50:17 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:17 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:50:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:50:20 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=33,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:50:20 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=18,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Flow 'volume_create_manager' (d49a442e-1d2b-480d-9368-729daf766cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5789bf4f-9463-4c88-9f07-5c459ea98e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5789bf4f-9463-4c88-9f07-5c459ea98e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-160602759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f582757-61e2-443a-ad28-1a3dc53707da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af974edef4f24a2db771e357f8b614fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:29Z,use_quota=True,user_id='a7c7c6e9d2da4eaab8833d2260237b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f9182e-6641-43a7-827b-9da9a1164fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f9182e-6641-43a7-827b-9da9a1164fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdcf8a7-f5c9-45ea-aba5-af76aa30b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efdcf8a7-f5c9-45ea-aba5-af76aa30b075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f582757-61e2-443a-ad28-1a3dc53707da', 'volume_name': 'volume-2f582757-61e2-443a-ad28-1a3dc53707da', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524b64f0-2043-4f72-b240-628c42258db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524b64f0-2043-4f72-b240-628c42258db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2125230a-6f10-4a81-b4d9-68e6172c8f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Volume 2f582757-61e2-443a-ad28-1a3dc53707da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f582757-61e2-443a-ad28-1a3dc53707da', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Trying to clone 2f582757-61e2-443a-ad28-1a3dc53707da from image babec01a-b62a-4774-aa41-a35db0f34a47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:50:29 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef9496-9dd5-406f-a337-f0e3b0369744]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:30 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD Sep 01 01:50:30 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:30 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 is fetched for user a7c7c6e9d2da4eaab8833d2260237b08. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63ca3d4-cb73-4c73-8a4e-12e57b797cc0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:30 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD Sep 01 01:50:30 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:30 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-160602759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f582757-61e2-443a-ad28-1a3dc53707da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af974edef4f24a2db771e357f8b614fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:29Z,use_quota=True,user_id='a7c7c6e9d2da4eaab8833d2260237b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Creating volume 2f582757-61e2-443a-ad28-1a3dc53707da {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:50:30 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:50:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:30 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 1073741824 Sep 01 01:50:30 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:31 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 1073741824" returned: 0 in 0.449s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:31 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da Sep 01 01:50:31 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:31 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da" returned: 0 in 0.251s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Attempting download of babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume 2f582757-61e2-443a-ad28-1a3dc53707da. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2748332-4743-434b-970c-9da7582dd03a]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_fmdamd1l {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:31 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_fmdamd1l Sep 01 01:50:31 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:32 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_fmdamd1l" returned: 0 in 0.327s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_fmdamd1l {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:32 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_fmdamd1l Sep 01 01:50:32 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:32 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_fmdamd1l" returned: 1 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_fmdamd1l' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc818cf-a128-4761-8316-63206ddc63a0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:32 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD Sep 01 01:50:32 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:32 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] babec01a-b62a-4774-aa41-a35db0f34a47 was qcow2, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:50:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:32 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da Sep 01 01:50:32 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:34 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da" returned: 0 in 1.722s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_w5erhcz2devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:50:34 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Converted 112.00 MB image at 64.98 MB/s Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:34 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 1G Sep 01 01:50:34 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:34 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 1G" returned: 0 in 0.374s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Downloaded image babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume 2f582757-61e2-443a-ad28-1a3dc53707da successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 for user a7c7c6e9d2da4eaab8833d2260237b08 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Marking volume 2f582757-61e2-443a-ad28-1a3dc53707da as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Copying metadata from image babec01a-b62a-4774-aa41-a35db0f34a47 to 2f582757-61e2-443a-ad28-1a3dc53707da. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Creating volume glance metadata for volume 2f582757-61e2-443a-ad28-1a3dc53707da backed by image babec01a-b62a-4774-aa41-a35db0f34a47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2125230a-6f10-4a81-b4d9-68e6172c8f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f582757-61e2-443a-ad28-1a3dc53707da', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadfd07a-eb60-4fae-84c3-f757f95855bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:35 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Volume volume-2f582757-61e2-443a-ad28-1a3dc53707da (2f582757-61e2-443a-ad28-1a3dc53707da): created successfully Sep 01 01:50:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadfd07a-eb60-4fae-84c3-f757f95855bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Flow 'volume_create_manager' (d49a442e-1d2b-480d-9368-729daf766cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7ef2467c-69c0-44c2-bb87-754ac9e72a63 tempest-VolumesExtendTest-1238379124 None] Created volume successfully. Sep 01 01:50:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:35 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[287955db-4a76-4e98-b28d-c7b8d3f017d0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:35 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da Sep 01 01:50:35 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:36 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da" returned: 0 in 0.457s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 2G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da 2G" returned: 0 in 0.124s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.603s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-965e68fd-b4ac-4580-83a4-0eba6b3b5c62 tempest-VolumesExtendTest-1238379124 None] Extend volume completed successfully. Sep 01 01:50:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "cinder-2f582757-61e2-443a-ad28-1a3dc53707da-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-2f582757-61e2-443a-ad28-1a3dc53707da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "cinder-quobyte-2f582757-61e2-443a-ad28-1a3dc53707da" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-2f582757-61e2-443a-ad28-1a3dc53707da" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b1a64-89dc-45e1-9d5d-92ae11c08d7e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:37 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da Sep 01 01:50:37 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:37 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da" returned: 0 in 0.356s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:37 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da Sep 01 01:50:37 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:37 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2f582757-61e2-443a-ad28-1a3dc53707da" returned: 0 in 0.269s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-2f582757-61e2-443a-ad28-1a3dc53707da" released by "delete_volume" :: held 0.666s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Created reservations ['c0068155-2ac0-427e-99e2-01031e896eff', '921177e0-a563-4ed1-8179-b0861cf76c4b', '7afab67a-3ac7-426b-a12b-bafc9ebf708a', '83f13652-abc5-488c-8c34-a5149b8a7238'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:37 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:50:37 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:38 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.263s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:50:38 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Deleted volume successfully. Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6a2d3848-6dea-4630-9410-6c24fb0373e5 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-2f582757-61e2-443a-ad28-1a3dc53707da-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Flow 'volume_create_manager' (72e5b896-8a56-4dd9-8706-135b4acaf517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0c35e9-42a7-4fe8-9539-7b931b539693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0c35e9-42a7-4fe8-9539-7b931b539693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-753305363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91655bd7-1728-43f3-a282-54ecb7303f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af974edef4f24a2db771e357f8b614fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:39Z,use_quota=True,user_id='a7c7c6e9d2da4eaab8833d2260237b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179cdf9c-39a6-4007-86fa-0b7d75fd24a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179cdf9c-39a6-4007-86fa-0b7d75fd24a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46714c4-98ba-425a-bd57-7009004ee21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e46714c4-98ba-425a-bd57-7009004ee21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91655bd7-1728-43f3-a282-54ecb7303f23', 'volume_name': 'volume-91655bd7-1728-43f3-a282-54ecb7303f23', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0e1c0a-fb84-4de2-8a66-d5e2dd427108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0e1c0a-fb84-4de2-8a66-d5e2dd427108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff1dc1-aba3-4cf4-b584-30c1e7e17dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Volume 91655bd7-1728-43f3-a282-54ecb7303f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91655bd7-1728-43f3-a282-54ecb7303f23', 'volume_size': 1} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-753305363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91655bd7-1728-43f3-a282-54ecb7303f23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af974edef4f24a2db771e357f8b614fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:39Z,use_quota=True,user_id='a7c7c6e9d2da4eaab8833d2260237b08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Creating volume 91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:50:38 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:50:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:38 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 1073741824 Sep 01 01:50:38 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:39 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 1073741824" returned: 0 in 0.457s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:39 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 Sep 01 01:50:39 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:39 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23" returned: 0 in 0.240s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff1dc1-aba3-4cf4-b584-30c1e7e17dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91655bd7-1728-43f3-a282-54ecb7303f23', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a3ef67-b7b1-4d61-90b2-e7f839fcac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Volume volume-91655bd7-1728-43f3-a282-54ecb7303f23 (91655bd7-1728-43f3-a282-54ecb7303f23): created successfully Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a3ef67-b7b1-4d61-90b2-e7f839fcac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Flow 'volume_create_manager' (72e5b896-8a56-4dd9-8706-135b4acaf517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-496f5dde-dd72-4f89-b5e7-61441a21a809 tempest-VolumesExtendTest-1238379124 None] Created volume successfully. Sep 01 01:50:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Creating offline snapshot 348453a5-f0ad-4645-87eb-90b207928b5a of volume 91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:50:40 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d059b8e5-2247-43b4-b81f-87bd5afc6794]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:41 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 Sep 01 01:50:41 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:41 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23" returned: 0 in 0.372s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:41 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a 1G Sep 01 01:50:41 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:41 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a 1G" returned: 0 in 0.494s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91655bd7-1728-43f3-a282-54ecb7303f23 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:41 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91655bd7-1728-43f3-a282-54ecb7303f23 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a Sep 01 01:50:41 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:42 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91655bd7-1728-43f3-a282-54ecb7303f23 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a" returned: 0 in 0.337s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:42 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a is being set with open permissions: ugo+rw Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:42 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a Sep 01 01:50:42 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:42 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a" returned: 0 in 0.246s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:42 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.info Sep 01 01:50:42 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:50:42 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Flow 'volume_create_manager' (c0d288e0-f283-4c4e-a5b3-048a41addd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd063e8d-459c-40f2-be2a-010c324f7936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.info" returned: 0 in 0.274s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:42 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.info is being set with open permissions: ugo+rw Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:42 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.info Sep 01 01:50:42 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd063e8d-459c-40f2-be2a-010c324f7936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2071904349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e295cef8-da69-4e0f-bc17-c272a7ca58d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f0951a230b49e19b9e4164e32a407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:43Z,use_quota=True,user_id='e58a25d325ac45fd890aa028c5b845be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940aba71-96a6-4a99-aa12-fa6b58f5b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940aba71-96a6-4a99-aa12-fa6b58f5b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44c58dc-bbe5-4b9d-b419-c26f3f7f1b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44c58dc-bbe5-4b9d-b419-c26f3f7f1b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e295cef8-da69-4e0f-bc17-c272a7ca58d4', 'volume_name': 'volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb39769-be70-47b2-bf63-e3381f5ec2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb39769-be70-47b2-bf63-e3381f5ec2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306a4fdb-ac57-4753-8857-d0a6a5523a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:42 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Volume e295cef8-da69-4e0f-bc17-c272a7ca58d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4', 'volume_size': 1} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:42 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.info" returned: 0 in 0.234s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2071904349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e295cef8-da69-4e0f-bc17-c272a7ca58d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27f0951a230b49e19b9e4164e32a407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:43Z,use_quota=True,user_id='e58a25d325ac45fd890aa028c5b845be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Creating volume e295cef8-da69-4e0f-bc17-c272a7ca58d4 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:50:42 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:50:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:43 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 1073741824 Sep 01 01:50:43 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e80c5ee5-89b7-4d4d-b60e-8141e5986c3b tempest-VolumesExtendTest-1238379124 None] Create snapshot completed successfully Sep 01 01:50:43 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 1073741824" returned: 0 in 0.376s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:43 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 Sep 01 01:50:43 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:43 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4" returned: 0 in 0.235s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] <== create_volume: return (648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306a4fdb-ac57-4753-8857-d0a6a5523a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c53057d-d217-426b-b60f-575168f9ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Volume volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 (e295cef8-da69-4e0f-bc17-c272a7ca58d4): created successfully Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c53057d-d217-426b-b60f-575168f9ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Flow 'volume_create_manager' (c0d288e0-f283-4c4e-a5b3-048a41addd29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-23709736-4af9-4f3d-aa09-cb9e207cfa80 tempest-TestImageHashVerification-2055892094 None] Created volume successfully. Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[787dcfed-ed71-4f8e-955a-62f084099572]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:44 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 Sep 01 01:50:44 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:44 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23" returned: 0 in 0.341s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a 2G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a 2G" returned: 0 in 0.105s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.475s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-dfe64116-1e1d-4199-841c-d66957e52c1c tempest-VolumesExtendTest-1238379124 None] Extend volume completed successfully. Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "cinder-348453a5-f0ad-4645-87eb-90b207928b5a-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-348453a5-f0ad-4645-87eb-90b207928b5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "cinder-quobyte-91655bd7-1728-43f3-a282-54ecb7303f23" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-91655bd7-1728-43f3-a282-54ecb7303f23" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Acquiring lock "cinder-quobyte-348453a5-f0ad-4645-87eb-90b207928b5a" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-348453a5-f0ad-4645-87eb-90b207928b5a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Deleting offline snapshot 348453a5-f0ad-4645-87eb-90b207928b5a of volume 91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] snapshot_file for this snap is: volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc1e86b-f63a-4852-94b2-695c62a2d4c7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d048d7f5-3c2a-47d6-9908-f7cf18bd48e0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:45 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a Sep 01 01:50:45 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:45 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 Sep 01 01:50:45 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:45 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a" returned: 0 in 0.353s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91655bd7-1728-43f3-a282-54ecb7303f23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a626a30-7d8d-4dc4-a605-ec23e4b3f0f7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:45 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4" returned: 0 in 0.357s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b5b9f6-e13d-4463-915a-0c867393ba27]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:45 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 Sep 01 01:50:45 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:46 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 Sep 01 01:50:46 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:46 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23" returned: 0 in 0.357s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:46 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a Sep 01 01:50:46 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:46 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4" returned: 0 in 0.345s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 /opt/stack/data/cinder/conversion/e295cef8-da69-4e0f-bc17-c272a7ca58d4.temp_image.1306d0de-91cb-4250-888e-3c85579e0d01_aw_d3pd.img {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:46 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 /opt/stack/data/cinder/conversion/e295cef8-da69-4e0f-bc17-c272a7ca58d4.temp_image.1306d0de-91cb-4250-888e-3c85579e0d01_aw_d3pd.img Sep 01 01:50:46 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:46 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a" returned: 0 in 0.375s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:46 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a Sep 01 01:50:46 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:47 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23.348453a5-f0ad-4645-87eb-90b207928b5a" returned: 0 in 0.534s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-348453a5-f0ad-4645-87eb-90b207928b5a" released by "_delete_snapshot" :: held 1.753s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-91655bd7-1728-43f3-a282-54ecb7303f23" released by "delete_snapshot" :: held 1.781s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Created reservations ['8a38b7cd-7e09-4b33-8cc7-68577cb851b1', '08548468-f345-4e20-ba9b-7da8d4b0acc8', '3eb1aea7-3782-49a8-baec-2dcf528d6a58', '8ab815f5-5db5-476a-a006-8dd89d4d279d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:50:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Delete snapshot completed successfully. Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-107b10c3-5c10-4ba8-aef5-06a7c21817d7 tempest-VolumesExtendTest-1238379124 None] Lock "cinder-348453a5-f0ad-4645-87eb-90b207928b5a-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Acquiring lock "cinder-91655bd7-1728-43f3-a282-54ecb7303f23-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Lock "cinder-91655bd7-1728-43f3-a282-54ecb7303f23-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Acquiring lock "cinder-quobyte-91655bd7-1728-43f3-a282-54ecb7303f23" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:50:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-91655bd7-1728-43f3-a282-54ecb7303f23" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:50:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8493339d-ab69-4035-95bb-99a605d57b6e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:48 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 Sep 01 01:50:48 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:49 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23" returned: 0 in 1.354s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:49 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23 Sep 01 01:50:49 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:49 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-91655bd7-1728-43f3-a282-54ecb7303f23" returned: 0 in 0.462s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Lock "cinder-quobyte-91655bd7-1728-43f3-a282-54ecb7303f23" released by "delete_volume" :: held 1.945s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Created reservations ['647c0450-fe67-49f3-9561-08b2a02bd83e', 'af06eaf2-9094-4722-94c1-165e4be84141', 'fb57cd37-8fef-4c0a-8b81-e3af6f006563', 'bb8e0876-bd8d-4902-b9d8-af8d86d46713'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:50 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:50:50 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:50 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 /opt/stack/data/cinder/conversion/e295cef8-da69-4e0f-bc17-c272a7ca58d4.temp_image.1306d0de-91cb-4250-888e-3c85579e0d01_aw_d3pd.img" returned: 0 in 4.122s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb1316-0cc2-4b62-9938-b9bf8c4734a7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:50:50 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 Sep 01 01:50:50 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:50:50 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:50:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Deleted volume successfully. Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e5871-16ea-4f51-8eb0-cda8ac19138d tempest-VolumesExtendTest-1238379124 None] Lock "cinder-91655bd7-1728-43f3-a282-54ecb7303f23-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:50:50 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4" returned: 0 in 0.574s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/conversion/e295cef8-da69-4e0f-bc17-c272a7ca58d4.temp_image.1306d0de-91cb-4250-888e-3c85579e0d01_aw_d3pd.img {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:50:50 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Converted 1024.00 MB image at 248.33 MB/s Sep 01 01:50:50 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] 1306d0de-91cb-4250-888e-3c85579e0d01 was raw, no need to convert to raw {{(pid=87212) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Flow 'volume_create_manager' (98e7730b-eba5-4ee7-a7a3-7716a3d809d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e691e2c-fc4f-4387-bfee-18ff3c1cf641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e691e2c-fc4f-4387-bfee-18ff3c1cf641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-943679496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50614aa0-0ead-4548-ad93-4a5a6d2de83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef49963343480598be9d19f6767972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:53Z,use_quota=True,user_id='6c5d5769d2464e528cbbe0895b682b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b1b305-ce06-4f46-9354-ea0eafac8c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b1b305-ce06-4f46-9354-ea0eafac8c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8632fe-5ba1-479c-b94c-d6413a5d1b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8632fe-5ba1-479c-b94c-d6413a5d1b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50614aa0-0ead-4548-ad93-4a5a6d2de83c', 'volume_name': 'volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7498d84d-f4d7-4e97-9f0f-db3602bca10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7498d84d-f4d7-4e97-9f0f-db3602bca10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7c703f-b960-437f-85bc-78b5481e2973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:50:53 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Volume 50614aa0-0ead-4548-ad93-4a5a6d2de83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c', 'volume_size': 1} Sep 01 01:50:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:03 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=41,cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:51:03 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=36,cinder:SELECT=36,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.873s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Uploaded volume to glance image-id: 1306d0de-91cb-4250-888e-3c85579e0d01. {{(pid=87212) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.157s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-943679496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50614aa0-0ead-4548-ad93-4a5a6d2de83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef49963343480598be9d19f6767972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:50:53Z,use_quota=True,user_id='6c5d5769d2464e528cbbe0895b682b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Creating volume 50614aa0-0ead-4548-ad93-4a5a6d2de83c {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:51:09 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b8fb125a-8cee-4ab2-8e03-748c93f4f462 tempest-TestImageHashVerification-2055892094 None] Copy volume to image completed successfully. Sep 01 01:51:09 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c 1073741824 Sep 01 01:51:09 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:09 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c 1073741824" returned: 0 in 0.464s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:09 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c Sep 01 01:51:09 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:10 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c" returned: 0 in 0.251s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:51:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7c703f-b960-437f-85bc-78b5481e2973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f484d203-154c-497c-94b5-0023702ff65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Volume volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c (50614aa0-0ead-4548-ad93-4a5a6d2de83c): created successfully Sep 01 01:51:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f484d203-154c-497c-94b5-0023702ff65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Flow 'volume_create_manager' (98e7730b-eba5-4ee7-a7a3-7716a3d809d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d0ce121f-5813-4783-8410-4c6ae398ed82 tempest-VolumesNegativeTest-342134826 None] Created volume successfully. Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Acquiring lock "cinder-e295cef8-da69-4e0f-bc17-c272a7ca58d4-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Lock "cinder-e295cef8-da69-4e0f-bc17-c272a7ca58d4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Acquiring lock "cinder-quobyte-e295cef8-da69-4e0f-bc17-c272a7ca58d4" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Lock "cinder-quobyte-e295cef8-da69-4e0f-bc17-c272a7ca58d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b644b4-d808-445b-9979-e3c7a666f586]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:11 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 Sep 01 01:51:11 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:11 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4" returned: 0 in 0.411s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:11 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4 Sep 01 01:51:11 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:11 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e295cef8-da69-4e0f-bc17-c272a7ca58d4" returned: 0 in 0.324s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Lock "cinder-quobyte-e295cef8-da69-4e0f-bc17-c272a7ca58d4" released by "delete_volume" :: held 0.778s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Created reservations ['8b984187-86bf-42a1-aeee-39c129384b5f', '7f911475-acac-450a-9599-10bd6f0e4c0a', '06f109f2-f8fb-45d1-b56d-83ff18d4faaf', '61e1592a-52b4-4b2c-925c-5fb162df711a'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:12 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:51:12 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:12 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.357s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:12 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:51:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Deleted volume successfully. Sep 01 01:51:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b377d371-0733-490a-9e02-73a220d986b8 tempest-TestImageHashVerification-2055892094 None] Lock "cinder-e295cef8-da69-4e0f-bc17-c272a7ca58d4-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:17 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:51:17 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:17 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.496s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:51:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:51:21 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:51:22 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:51:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Acquiring lock "cinder-50614aa0-0ead-4548-ad93-4a5a6d2de83c-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Lock "cinder-50614aa0-0ead-4548-ad93-4a5a6d2de83c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Acquiring lock "cinder-quobyte-50614aa0-0ead-4548-ad93-4a5a6d2de83c" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Lock "cinder-quobyte-50614aa0-0ead-4548-ad93-4a5a6d2de83c" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:28 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b29f025-ee77-4440-b38c-ae25db176276]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:28 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c Sep 01 01:51:28 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:29 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:29 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c Sep 01 01:51:29 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:29 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50614aa0-0ead-4548-ad93-4a5a6d2de83c" returned: 0 in 0.351s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Lock "cinder-quobyte-50614aa0-0ead-4548-ad93-4a5a6d2de83c" released by "delete_volume" :: held 0.759s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Created reservations ['f7d95190-32d6-41ae-9585-5505a34ace88', '5a1f5c24-b7dd-4fd4-a10c-812177c37af4', '1fff0d38-a701-42f6-aa58-d6cb25f66bb1', '070cc211-e853-4da0-b574-dfd7b3fd96ce'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:29 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:51:29 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:29 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.291s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:29 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:51:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Deleted volume successfully. Sep 01 01:51:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c6b15f2-e520-490b-a0aa-b96512a7c1ba tempest-VolumesNegativeTest-342134826 None] Lock "cinder-50614aa0-0ead-4548-ad93-4a5a6d2de83c-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:51:39 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:51:40 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:51:43 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:51:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (9111598f-e3dc-41be-983d-632347742f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d97388e-c02c-4546-81b1-bc5af7c35f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d97388e-c02c-4546-81b1-bc5af7c35f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1074808853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b3c97b-2a82-419f-829b-ee87499a56ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:51:44Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5625c0-7cba-4b09-8bd5-25e0928bf5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5625c0-7cba-4b09-8bd5-25e0928bf5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83357723-aed8-4d04-bf9f-b47d27d39eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83357723-aed8-4d04-bf9f-b47d27d39eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b3c97b-2a82-419f-829b-ee87499a56ea', 'volume_name': 'volume-23b3c97b-2a82-419f-829b-ee87499a56ea', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b437139-66b4-4972-8233-d9686700711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b437139-66b4-4972-8233-d9686700711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1bcc314-0ffc-4e4d-8f74-877ea3775e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:44 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume 23b3c97b-2a82-419f-829b-ee87499a56ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b3c97b-2a82-419f-829b-ee87499a56ea', 'volume_size': 1} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1074808853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b3c97b-2a82-419f-829b-ee87499a56ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:51:44Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Creating volume 23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:51:44 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:44 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea 1073741824 Sep 01 01:51:44 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:44 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea 1073741824" returned: 0 in 0.423s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:44 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea Sep 01 01:51:44 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:44 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea" returned: 0 in 0.316s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1bcc314-0ffc-4e4d-8f74-877ea3775e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b3c97b-2a82-419f-829b-ee87499a56ea', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80810f6-9070-4873-8f5a-bcce0aab586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:44 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume volume-23b3c97b-2a82-419f-829b-ee87499a56ea (23b3c97b-2a82-419f-829b-ee87499a56ea): created successfully Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80810f6-9070-4873-8f5a-bcce0aab586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (9111598f-e3dc-41be-983d-632347742f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-542b9f78-2349-45d0-bc40-b81f81382050 tempest-VolumesSnapshotTestJSON-1386849561 None] Created volume successfully. Sep 01 01:51:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Creating offline snapshot 433f5d1b-d6dc-4b23-bc3f-4785049a41fb of volume 23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:51:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8e0982-e56c-4de9-b619-1312aa29e402]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:45 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea Sep 01 01:51:45 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:45 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea" returned: 0 in 0.419s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:45 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb 1G Sep 01 01:51:45 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:46 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb 1G" returned: 0 in 0.534s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b3c97b-2a82-419f-829b-ee87499a56ea -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:46 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b3c97b-2a82-419f-829b-ee87499a56ea -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb Sep 01 01:51:46 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:46 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23b3c97b-2a82-419f-829b-ee87499a56ea -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:46 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb is being set with open permissions: ugo+rw Sep 01 01:51:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:46 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb Sep 01 01:51:46 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:46 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:46 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.info Sep 01 01:51:46 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:47 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.info" returned: 0 in 0.253s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:47 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.info is being set with open permissions: ugo+rw Sep 01 01:51:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:47 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.info Sep 01 01:51:47 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:47 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.info" returned: 0 in 0.248s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1cfa266a-5dda-4034-bb5b-3e8ff3422578 tempest-VolumesSnapshotTestJSON-1386849561 None] Create snapshot completed successfully Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-433f5d1b-d6dc-4b23-bc3f-4785049a41fb-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-433f5d1b-d6dc-4b23-bc3f-4785049a41fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-23b3c97b-2a82-419f-829b-ee87499a56ea" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-23b3c97b-2a82-419f-829b-ee87499a56ea" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-433f5d1b-d6dc-4b23-bc3f-4785049a41fb" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-433f5d1b-d6dc-4b23-bc3f-4785049a41fb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Deleting offline snapshot 433f5d1b-d6dc-4b23-bc3f-4785049a41fb of volume 23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] snapshot_file for this snap is: volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d268e-3356-46da-bd2e-6abfc6c4f6ab]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:48 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb Sep 01 01:51:48 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:49 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb" returned: 0 in 0.395s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23b3c97b-2a82-419f-829b-ee87499a56ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c88ee18-feb6-4bcf-b325-95ea30ad263a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:49 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea Sep 01 01:51:49 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:49 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea" returned: 0 in 0.411s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:49 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb Sep 01 01:51:49 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:49 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb" returned: 0 in 0.349s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:49 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb Sep 01 01:51:49 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:50 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea.433f5d1b-d6dc-4b23-bc3f-4785049a41fb" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-433f5d1b-d6dc-4b23-bc3f-4785049a41fb" released by "_delete_snapshot" :: held 1.549s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:51:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-23b3c97b-2a82-419f-829b-ee87499a56ea" released by "delete_snapshot" :: held 1.572s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:51:50 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['eecaa9bb-aa0b-4741-8550-e21d16560f35', '9df04de4-c9b2-4d68-b26e-e7f30a8bf8ca', '736108a5-fe18-46a0-a5f9-a65ec6726773', 'e842e118-3651-4674-bf0a-76a2c5648157'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:51:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Delete snapshot completed successfully. Sep 01 01:51:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-109f4fee-6f88-4444-97c2-8db837480ebc tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-433f5d1b-d6dc-4b23-bc3f-4785049a41fb-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (cae45590-0fdd-42e8-b005-416c1bfa3958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc88f3b0-8c75-4035-b058-61bc8209cdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc88f3b0-8c75-4035-b058-61bc8209cdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2078681582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137a912b-1c67-4d76-a6cc-ac4ca11268c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:51:51Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3dc39-6695-4719-b899-cff26ee2b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3dc39-6695-4719-b899-cff26ee2b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c6a10d-2d91-4e7c-9063-d73332eac9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c6a10d-2d91-4e7c-9063-d73332eac9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137a912b-1c67-4d76-a6cc-ac4ca11268c0', 'volume_name': 'volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0c6567-4fbc-46b2-a010-c2d66837246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0c6567-4fbc-46b2-a010-c2d66837246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719ec400-caa4-4caa-93ef-4769699c4ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume 137a912b-1c67-4d76-a6cc-ac4ca11268c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0', 'volume_size': 1} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2078681582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137a912b-1c67-4d76-a6cc-ac4ca11268c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:51:51Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Creating volume 137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:51:51 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:51 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 1073741824 Sep 01 01:51:51 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Flow 'volume_create_manager' (83a5bea2-b3dd-4609-9127-af4da6be9c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b828c66-360b-4252-9fdf-984ee27d9099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b828c66-360b-4252-9fdf-984ee27d9099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-69611563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ca1f0-fabb-431e-b001-7622da2b8b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c05b9c388b4d50a2cba77382d8b35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:51:52Z,use_quota=True,user_id='03a456ea5a9144d1a9e517f73fecbc7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7637b001-0eaf-4b3b-968b-eeb11403c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7637b001-0eaf-4b3b-968b-eeb11403c117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f00ea13-82a0-4d8d-9511-5640b46c6733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f00ea13-82a0-4d8d-9511-5640b46c6733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82ca1f0-fabb-431e-b001-7622da2b8b03', 'volume_name': 'volume-f82ca1f0-fabb-431e-b001-7622da2b8b03', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37e5b6d-eca3-47a2-9c05-5360dab12c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37e5b6d-eca3-47a2-9c05-5360dab12c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3140cb-9583-4585-92af-89075a5a0a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:51 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Volume f82ca1f0-fabb-431e-b001-7622da2b8b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82ca1f0-fabb-431e-b001-7622da2b8b03', 'volume_size': 1} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 1073741824" returned: 0 in 0.542s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:51 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 Sep 01 01:51:51 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:52 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0" returned: 0 in 0.271s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-69611563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ca1f0-fabb-431e-b001-7622da2b8b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c05b9c388b4d50a2cba77382d8b35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:51:52Z,use_quota=True,user_id='03a456ea5a9144d1a9e517f73fecbc7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Creating volume f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:51:52 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (719ec400-caa4-4caa-93ef-4769699c4ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:52 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 1073741824 Sep 01 01:51:52 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bad352-99ae-4ecf-ac78-7d3162fcc50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 (137a912b-1c67-4d76-a6cc-ac4ca11268c0): created successfully Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bad352-99ae-4ecf-ac78-7d3162fcc50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (cae45590-0fdd-42e8-b005-416c1bfa3958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:52 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-068a9855-7348-4ae2-a6bc-bb363b721829 tempest-VolumesSnapshotTestJSON-1386849561 None] Created volume successfully. Sep 01 01:51:52 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 1073741824" returned: 0 in 0.470s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:52 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 Sep 01 01:51:52 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:53 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3140cb-9583-4585-92af-89075a5a0a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82ca1f0-fabb-431e-b001-7622da2b8b03', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f26f0d-cf4d-407c-ae39-ab9ea95326a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:53 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Volume volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 (f82ca1f0-fabb-431e-b001-7622da2b8b03): created successfully Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7f26f0d-cf4d-407c-ae39-ab9ea95326a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Flow 'volume_create_manager' (83a5bea2-b3dd-4609-9127-af4da6be9c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-41a8087b-833e-49bd-81ab-9e024f890032 tempest-TestStampPattern-1951739022 None] Created volume successfully. Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Creating offline snapshot 368c3762-6388-49a7-966b-e1dd9c0eee40 of volume 137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1dfdec-273a-4d58-b344-5202952c0055]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:53 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 Sep 01 01:51:53 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:54 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0" returned: 0 in 0.400s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:54 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 1G Sep 01 01:51:54 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:54 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 1G" returned: 0 in 0.482s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:54 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 Sep 01 01:51:54 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:54 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40" returned: 0 in 0.405s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:54 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 is being set with open permissions: ugo+rw Sep 01 01:51:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:54 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 Sep 01 01:51:54 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:55 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:55 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.info Sep 01 01:51:55 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:55 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.info" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:55 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.info is being set with open permissions: ugo+rw Sep 01 01:51:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:55 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.info Sep 01 01:51:55 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:55 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.info" returned: 0 in 0.265s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:55 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e112d898-3d9a-4dfd-9db1-eab0729220d1 tempest-VolumesSnapshotTestJSON-1386849561 None] Create snapshot completed successfully Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (55413ae3-5655-41cb-b134-aa7183ffbd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ba7140-45f8-486f-b5e1-d7c7f40d59a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ba7140-45f8-486f-b5e1-d7c7f40d59a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-128653399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e481ac-4625-4d4a-8152-a8561ed4d056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:51:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=368c3762-6388-49a7-966b-e1dd9c0eee40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:51:58Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf5c323-bf39-4eef-8143-46ee8dddcdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf5c323-bf39-4eef-8143-46ee8dddcdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e09425e-23a0-4f84-bc3c-5dffeb2d354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e09425e-23a0-4f84-bc3c-5dffeb2d354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08e481ac-4625-4d4a-8152-a8561ed4d056', 'volume_name': 'volume-08e481ac-4625-4d4a-8152-a8561ed4d056', 'volume_size': 2, 'snapshot_id': '368c3762-6388-49a7-966b-e1dd9c0eee40'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a687f1fc-a9b9-46fb-a788-96eb8392e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a687f1fc-a9b9-46fb-a788-96eb8392e157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4087c729-7904-4e3c-98c8-27bdfa865299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:51:57 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Volume 08e481ac-4625-4d4a-8152-a8561ed4d056: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08e481ac-4625-4d4a-8152-a8561ed4d056', 'volume_size': 2, 'snapshot_id': '368c3762-6388-49a7-966b-e1dd9c0eee40'} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-368c3762-6388-49a7-966b-e1dd9c0eee40-08e481ac-4625-4d4a-8152-a8561ed4d056" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-368c3762-6388-49a7-966b-e1dd9c0eee40-08e481ac-4625-4d4a-8152-a8561ed4d056" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Creating volume 08e481ac-4625-4d4a-8152-a8561ed4d056 from snapshot 368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-08e481ac-4625-4d4a-8152-a8561ed4d056" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-08e481ac-4625-4d4a-8152-a8561ed4d056" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] snapshot: 368c3762-6388-49a7-966b-e1dd9c0eee40, volume: 08e481ac-4625-4d4a-8152-a8561ed4d056, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b2a608-fbd8-41b3-ad66-d188db92052e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:58 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 Sep 01 01:51:58 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:58 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40" returned: 0 in 0.439s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fa27d4-bdc7-4758-96f5-143efaa97884]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:58 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 Sep 01 01:51:58 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:51:58 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0" returned: 0 in 0.377s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:51:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:51:58 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 Sep 01 01:51:58 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:04 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056" returned: 0 in 5.274s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:52:04 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Converted 1024.00 MB image at 194.11 MB/s Sep 01 01:52:04 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 is being set with open permissions: ugo+rw Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:04 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 Sep 01 01:52:04 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:04 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056" returned: 0 in 0.258s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-08e481ac-4625-4d4a-8152-a8561ed4d056" released by "_copy_volume_from_snapshot" :: held 6.447s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-368c3762-6388-49a7-966b-e1dd9c0eee40-08e481ac-4625-4d4a-8152-a8561ed4d056" released by "_create_volume_from_snapshot" :: held 6.550s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.572s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4087c729-7904-4e3c-98c8-27bdfa865299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e481ac-4625-4d4a-8152-a8561ed4d056', 'volume_size': 2, 'snapshot_id': '368c3762-6388-49a7-966b-e1dd9c0eee40'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f7d45c-feff-498f-9e2c-0482f61af782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Volume volume-08e481ac-4625-4d4a-8152-a8561ed4d056 (08e481ac-4625-4d4a-8152-a8561ed4d056): created successfully Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f7d45c-feff-498f-9e2c-0482f61af782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (55413ae3-5655-41cb-b134-aa7183ffbd00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:52:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e4952ace-4c23-435b-ae46-a4370a4654ba tempest-VolumesSnapshotTestJSON-1386849561 None] Created volume successfully. Sep 01 01:52:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-08e481ac-4625-4d4a-8152-a8561ed4d056-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-08e481ac-4625-4d4a-8152-a8561ed4d056-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-08e481ac-4625-4d4a-8152-a8561ed4d056" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-08e481ac-4625-4d4a-8152-a8561ed4d056" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:05 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9716f6aa-01b0-4d4c-ad76-816fa002a246]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:05 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 Sep 01 01:52:05 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:06 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056" returned: 0 in 0.367s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:06 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056 Sep 01 01:52:06 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:06 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-08e481ac-4625-4d4a-8152-a8561ed4d056" returned: 0 in 0.245s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-08e481ac-4625-4d4a-8152-a8561ed4d056" released by "delete_volume" :: held 0.653s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['4252a182-4d73-4cec-9e48-43183315056d', 'c24b3da4-56a0-4e49-872f-4c10cd43fe09', '92d3a489-30af-475d-a3dd-9d542df40098', 'e4930798-0682-46fd-8f5b-ebfd512e3530'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:06 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:52:06 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:06 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:52:06 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Deleted volume successfully. Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-64eb9295-4347-4da8-8e71-233bb9ab5496 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-08e481ac-4625-4d4a-8152-a8561ed4d056-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-368c3762-6388-49a7-966b-e1dd9c0eee40-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-368c3762-6388-49a7-966b-e1dd9c0eee40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-137a912b-1c67-4d76-a6cc-ac4ca11268c0" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-137a912b-1c67-4d76-a6cc-ac4ca11268c0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-368c3762-6388-49a7-966b-e1dd9c0eee40" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-368c3762-6388-49a7-966b-e1dd9c0eee40" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Deleting offline snapshot 368c3762-6388-49a7-966b-e1dd9c0eee40 of volume 137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] snapshot_file for this snap is: volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d91966-66a1-4c44-a0f2-609be530f444]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:07 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 Sep 01 01:52:07 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:07 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40" returned: 0 in 0.419s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e58e0-ff1d-41c3-b0a6-20d08d7f224b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:07 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 Sep 01 01:52:07 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:08 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0" returned: 0 in 0.589s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:08 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 Sep 01 01:52:08 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:08 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40" returned: 0 in 0.335s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:08 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40 Sep 01 01:52:08 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:08 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0.368c3762-6388-49a7-966b-e1dd9c0eee40" returned: 0 in 0.268s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-368c3762-6388-49a7-966b-e1dd9c0eee40" released by "_delete_snapshot" :: held 1.711s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-137a912b-1c67-4d76-a6cc-ac4ca11268c0" released by "delete_snapshot" :: held 1.736s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['c31eeb34-1f9e-4843-b634-54b4856607d3', '26177ce4-9441-488b-ba5f-32a1629bf4d1', '28a46b3e-6667-48c8-a604-2c3b075d4286', 'cbd56a10-5c99-48be-971d-218728805367'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:52:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Delete snapshot completed successfully. Sep 01 01:52:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-04d8a835-dba2-4631-bd29-1d04711ad30a tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-368c3762-6388-49a7-966b-e1dd9c0eee40-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-137a912b-1c67-4d76-a6cc-ac4ca11268c0-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-137a912b-1c67-4d76-a6cc-ac4ca11268c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-137a912b-1c67-4d76-a6cc-ac4ca11268c0" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-137a912b-1c67-4d76-a6cc-ac4ca11268c0" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f6f2b-1f4f-4497-9142-95b8a374875a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:09 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 Sep 01 01:52:09 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:09 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0" returned: 0 in 0.341s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:09 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0 Sep 01 01:52:09 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:09 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-137a912b-1c67-4d76-a6cc-ac4ca11268c0" returned: 0 in 0.237s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-137a912b-1c67-4d76-a6cc-ac4ca11268c0" released by "delete_volume" :: held 0.653s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:09 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['555d42d7-7bcd-4a2b-82d0-646e67cf98fb', 'c4a60d6e-87ac-4f5d-819d-102e843997e5', 'cc58d0b0-4ecb-4a24-b0dc-148b1a0ff59c', 'dd2bac04-0995-4edd-af13-bf704ae526b1'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:10 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:52:10 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:10 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.287s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:52:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Deleted volume successfully. Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4874872d-df90-45f9-9e3b-79b4e07314aa tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-137a912b-1c67-4d76-a6cc-ac4ca11268c0-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (416b4e9f-f3f1-481f-b817-0fd31b6477cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5200e008-89b3-4726-ac2b-75fc1e0257ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5200e008-89b3-4726-ac2b-75fc1e0257ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-246510523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:52:11Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f299f7-b4ad-4a89-8ccd-87d6c8e993be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f299f7-b4ad-4a89-8ccd-87d6c8e993be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708f4209-e5cd-4bab-a951-6f1b8e0756bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708f4209-e5cd-4bab-a951-6f1b8e0756bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a', 'volume_name': 'volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc36fd1-bc64-4975-9c85-198ffcda84a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc36fd1-bc64-4975-9c85-198ffcda84a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911b8427-7af7-4b54-9dd4-9e040da11d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume 36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a', 'volume_size': 1} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-246510523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:52:11Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Creating volume 36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:52:11 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:11 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a 1073741824 Sep 01 01:52:11 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:11 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a 1073741824" returned: 0 in 0.382s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:11 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a Sep 01 01:52:11 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:11 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911b8427-7af7-4b54-9dd4-9e040da11d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e9deee-838c-4a9b-b48a-5ad17c66b509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Volume volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a (36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a): created successfully Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e9deee-838c-4a9b-b48a-5ad17c66b509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (416b4e9f-f3f1-481f-b817-0fd31b6477cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:52:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9e31706a-a19c-4bcc-aadc-38dbb32bb912 tempest-VolumesSnapshotTestJSON-1386849561 None] Created volume successfully. Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Creating offline snapshot 9ce6f675-2ec1-45f3-9bcb-13138423758d of volume 36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[78155694-a156-41ea-8e82-197ea5864485]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:12 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a Sep 01 01:52:12 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:12 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" returned: 0 in 0.341s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:12 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d 1G Sep 01 01:52:12 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:12 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d 1G" returned: 0 in 0.371s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:12 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d Sep 01 01:52:12 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:13 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d" returned: 0 in 0.280s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:13 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d is being set with open permissions: ugo+rw Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:13 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d Sep 01 01:52:13 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:13 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d" returned: 0 in 0.225s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:13 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.info Sep 01 01:52:13 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:13 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.info" returned: 0 in 0.248s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:13 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.info is being set with open permissions: ugo+rw Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:13 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.info Sep 01 01:52:13 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:13 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.info" returned: 0 in 0.258s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:13 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5598668c-bea0-487c-ae00-9b03a492b6fb tempest-VolumesSnapshotTestJSON-1386849561 None] Create snapshot completed successfully Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (ee05f8d5-5980-492a-8795-36b467dbc3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba8f5f7-9340-4073-b135-8c3385214d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba8f5f7-9340-4073-b135-8c3385214d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1027564464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a0a40f6-0abd-467d-b7d8-2e207ed4e097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619955a5c6f4f5988c056a41a1b2ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ce6f675-2ec1-45f3-9bcb-13138423758d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:52:15Z,use_quota=True,user_id='732b5de646174430abf54720e775bf8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cceb928d-b4a2-40b4-baf5-b21d4a37f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cceb928d-b4a2-40b4-baf5-b21d4a37f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a20418-e4d4-4bba-8d3d-fa3102fa423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a20418-e4d4-4bba-8d3d-fa3102fa423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a0a40f6-0abd-467d-b7d8-2e207ed4e097', 'volume_name': 'volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097', 'volume_size': 1, 'snapshot_id': '9ce6f675-2ec1-45f3-9bcb-13138423758d'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b5131a-5860-41e7-9a07-7078378a3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b5131a-5860-41e7-9a07-7078378a3451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bd62fa-9104-411b-8f79-773747505247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:14 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Volume 4a0a40f6-0abd-467d-b7d8-2e207ed4e097: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097', 'volume_size': 1, 'snapshot_id': '9ce6f675-2ec1-45f3-9bcb-13138423758d'} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-9ce6f675-2ec1-45f3-9bcb-13138423758d-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-9ce6f675-2ec1-45f3-9bcb-13138423758d-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Creating volume 4a0a40f6-0abd-467d-b7d8-2e207ed4e097 from snapshot 9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] snapshot: 9ce6f675-2ec1-45f3-9bcb-13138423758d, volume: 4a0a40f6-0abd-467d-b7d8-2e207ed4e097, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[09509e93-e0ab-41cf-adee-77fd5ad919e7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:14 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d Sep 01 01:52:14 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:15 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e14f0f-cc45-4131-8c23-283665da0a91]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:15 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a Sep 01 01:52:15 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:15 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" returned: 0 in 0.349s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:52:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:15 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 Sep 01 01:52:15 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:17 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:52:17 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:17 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.396s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:52:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:52:19 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" returned: 0 in 4.281s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:19 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:52:19 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Converted 1024.00 MB image at 239.12 MB/s Sep 01 01:52:19 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 is being set with open permissions: ugo+rw Sep 01 01:52:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:19 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 Sep 01 01:52:19 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:20 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" returned: 0 in 0.251s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" released by "_copy_volume_from_snapshot" :: held 5.301s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-9ce6f675-2ec1-45f3-9bcb-13138423758d-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" released by "_create_volume_from_snapshot" :: held 5.370s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.386s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97bd62fa-9104-411b-8f79-773747505247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097', 'volume_size': 1, 'snapshot_id': '9ce6f675-2ec1-45f3-9bcb-13138423758d'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f7df56-6908-49d7-8748-fb8956d83a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:20 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Volume volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 (4a0a40f6-0abd-467d-b7d8-2e207ed4e097): created successfully Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f7df56-6908-49d7-8748-fb8956d83a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Flow 'volume_create_manager' (ee05f8d5-5980-492a-8795-36b467dbc3ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:52:20 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fcb16a51-f6c1-4e95-bbab-5968cc21f07e tempest-VolumesSnapshotTestJSON-1386849561 None] Created volume successfully. Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-4a0a40f6-0abd-467d-b7d8-2e207ed4e097-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-4a0a40f6-0abd-467d-b7d8-2e207ed4e097-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ebf207-9820-47f0-b978-45701eb3f737]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:21 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 Sep 01 01:52:21 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:21 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" returned: 0 in 0.351s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:21 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097 Sep 01 01:52:21 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:22 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" returned: 0 in 0.246s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-4a0a40f6-0abd-467d-b7d8-2e207ed4e097" released by "delete_volume" :: held 0.641s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['45f33574-f538-48af-aef5-7f1e32fe9534', '22c59502-1386-47ba-9509-12baf888b9b7', '690c3117-9b8f-4946-80ec-4f607edc7d78', 'cf89438a-ca7d-4176-b768-789ce1f46dca'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:22 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:52:22 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:22 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.292s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:52:22 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Deleted volume successfully. Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5f68ab15-19a7-4c95-a48e-326198538b75 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-4a0a40f6-0abd-467d-b7d8-2e207ed4e097-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-9ce6f675-2ec1-45f3-9bcb-13138423758d-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-9ce6f675-2ec1-45f3-9bcb-13138423758d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-9ce6f675-2ec1-45f3-9bcb-13138423758d" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-9ce6f675-2ec1-45f3-9bcb-13138423758d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Deleting offline snapshot 9ce6f675-2ec1-45f3-9bcb-13138423758d of volume 36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] snapshot_file for this snap is: volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87cbdb1-6446-459d-96ab-db775ef21a16]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:22 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d Sep 01 01:52:22 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:22 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d" returned: 0 in 0.346s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af6092-256b-44ba-b3f8-9edb9e899027]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:23 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a Sep 01 01:52:23 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:23 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" returned: 0 in 0.507s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:23 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d Sep 01 01:52:23 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:23 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d" returned: 0 in 0.326s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:23 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d Sep 01 01:52:23 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:24 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a.9ce6f675-2ec1-45f3-9bcb-13138423758d" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-9ce6f675-2ec1-45f3-9bcb-13138423758d" released by "_delete_snapshot" :: held 1.536s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" released by "delete_snapshot" :: held 1.558s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['568dc36f-f471-475b-9076-79809e003685', 'a6fe699d-df02-4914-9aef-869a4fcea31e', '85d30f82-0770-4097-a433-151aecdfebeb', '4d6117ab-8cc8-49eb-be2e-8c4e5111c4c0'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:52:24 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Delete snapshot completed successfully. Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99b283d3-8721-4611-8766-5a48f1440fc9 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-9ce6f675-2ec1-45f3-9bcb-13138423758d-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" acquired by "delete_volume" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08eecab-0ec5-4282-87b0-5b2e907c5ce2]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:25 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a Sep 01 01:52:25 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:25 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" returned: 0 in 0.390s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:25 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a Sep 01 01:52:25 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:25 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" returned: 0 in 0.255s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a" released by "delete_volume" :: held 0.719s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-21c74e19-d69b-48ca-8dee-d27e412e6559 req-78b72437-ecef-4987-9851-de9adca84b42 tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-21c74e19-d69b-48ca-8dee-d27e412e6559 req-78b72437-ecef-4987-9851-de9adca84b42 tempest-TestStampPattern-1951739022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-21c74e19-d69b-48ca-8dee-d27e412e6559 req-78b72437-ecef-4987-9851-de9adca84b42 tempest-TestStampPattern-1951739022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-21c74e19-d69b-48ca-8dee-d27e412e6559 req-78b72437-ecef-4987-9851-de9adca84b42 tempest-TestStampPattern-1951739022 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-f82ca1f0-fabb-431e-b001-7622da2b8b03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '195dbdf2-2790-4d3b-9f29-b9194f0cf21b', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['4f70552e-21ce-42d5-af7f-094453be05cd', '24b44e7b-e29b-453f-ae19-ad92498edb89', '5df877a2-b88a-466d-b351-0115993a0909', '05b12781-dd49-4dbc-86fb-dff1abb12af3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:52:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-21c74e19-d69b-48ca-8dee-d27e412e6559 req-78b72437-ecef-4987-9851-de9adca84b42 tempest-TestStampPattern-1951739022 None] attachment_update completed successfully. Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:25 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:52:25 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:26 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-23b3c97b-2a82-419f-829b-ee87499a56ea-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:52:26 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Deleted volume successfully. Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-23b3c97b-2a82-419f-829b-ee87499a56ea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ec40b472-5ce0-40c8-9ba3-7ff1400a8117 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-36409f8f-4c4c-4ba8-b2bb-335ea6d7a54a-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "cinder-quobyte-23b3c97b-2a82-419f-829b-ee87499a56ea" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-23b3c97b-2a82-419f-829b-ee87499a56ea" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac01736-11b5-4187-8f71-e060777c2c15]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:26 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea Sep 01 01:52:26 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:26 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea" returned: 0 in 0.392s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:26 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea Sep 01 01:52:26 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:26 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-23b3c97b-2a82-419f-829b-ee87499a56ea" returned: 0 in 0.265s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-quobyte-23b3c97b-2a82-419f-829b-ee87499a56ea" released by "delete_volume" :: held 0.714s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Created reservations ['99ffa942-742d-4bbf-bcba-4e01c5d2286d', '6dc5fb5c-e6b5-45b8-a171-2cc026c0226c', '3aef04ff-6480-48f7-8ece-610003920140', '19bda6cd-cee7-4188-9240-28313a2fedba'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:27 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:52:27 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:27 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:27 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:52:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Deleted volume successfully. Sep 01 01:52:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a672a4fb-814e-4c9d-bb4a-7b8e7dfa63a3 tempest-VolumesSnapshotTestJSON-1386849561 None] Lock "cinder-23b3c97b-2a82-419f-829b-ee87499a56ea-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-060cb01d-d97f-4219-b6ae-7a38f7259502 req-b05793c8-5f5b-4208-963a-e2dc11354b9d tempest-TestStampPattern-1951739022 None] Terminate volume connection completed successfully. Sep 01 01:52:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-060cb01d-d97f-4219-b6ae-7a38f7259502 req-b05793c8-5f5b-4208-963a-e2dc11354b9d tempest-TestStampPattern-1951739022 None] Deleting attachment 195dbdf2-2790-4d3b-9f29-b9194f0cf21b. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:52:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Creating offline snapshot 881d6e0c-8263-4fc9-b468-c2263a2237ca of volume f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:52:32 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef638d3e-95e8-4121-b29e-caa096f77bba]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:32 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 Sep 01 01:52:32 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:32 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03" returned: 0 in 0.433s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:32 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca 1G Sep 01 01:52:32 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:32 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca 1G" returned: 0 in 0.448s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:32 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca Sep 01 01:52:32 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:33 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca" returned: 0 in 0.359s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca is being set with open permissions: ugo+rw Sep 01 01:52:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca Sep 01 01:52:33 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:33 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.info Sep 01 01:52:33 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:33 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.info" returned: 0 in 0.297s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:33 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.info is being set with open permissions: ugo+rw Sep 01 01:52:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:33 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.info Sep 01 01:52:33 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:34 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.info" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:34 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-19f9ac0b-e917-4ead-b32b-cd527c7b47fd tempest-TestStampPattern-1951739022 None] Create snapshot completed successfully Sep 01 01:52:41 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=89,cinder:INSERT=18,cinder:UPDATE=80,cinder:DELETE=10 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:41 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=87,cinder:SELECT=81,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Flow 'volume_create_manager' (fefc2885-f36e-4d3f-9d01-068f583e68e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee07d85-5642-4d1f-983f-d8638191147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bee07d85-5642-4d1f-983f-d8638191147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1365408139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a7c0ed-827b-41ed-b199-82194ffb881f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c05b9c388b4d50a2cba77382d8b35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=881d6e0c-8263-4fc9-b468-c2263a2237ca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:52:42Z,use_quota=True,user_id='03a456ea5a9144d1a9e517f73fecbc7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28135a0-754c-453f-8c71-9be548645943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28135a0-754c-453f-8c71-9be548645943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d698cc6-e129-484e-8363-1efdb0d0ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d698cc6-e129-484e-8363-1efdb0d0ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9a7c0ed-827b-41ed-b199-82194ffb881f', 'volume_name': 'volume-a9a7c0ed-827b-41ed-b199-82194ffb881f', 'volume_size': 1, 'snapshot_id': '881d6e0c-8263-4fc9-b468-c2263a2237ca'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7086f4e7-b1dc-48e6-b7ee-c8f25add4266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7086f4e7-b1dc-48e6-b7ee-c8f25add4266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3726d1d6-ebd4-4ece-b5f7-71cc71336a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:42 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Volume a9a7c0ed-827b-41ed-b199-82194ffb881f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9a7c0ed-827b-41ed-b199-82194ffb881f', 'volume_size': 1, 'snapshot_id': '881d6e0c-8263-4fc9-b468-c2263a2237ca'} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-quobyte-881d6e0c-8263-4fc9-b468-c2263a2237ca-a9a7c0ed-827b-41ed-b199-82194ffb881f" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-881d6e0c-8263-4fc9-b468-c2263a2237ca-a9a7c0ed-827b-41ed-b199-82194ffb881f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Creating volume a9a7c0ed-827b-41ed-b199-82194ffb881f from snapshot 881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-quobyte-a9a7c0ed-827b-41ed-b199-82194ffb881f" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-a9a7c0ed-827b-41ed-b199-82194ffb881f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] snapshot: 881d6e0c-8263-4fc9-b468-c2263a2237ca, volume: a9a7c0ed-827b-41ed-b199-82194ffb881f, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[003db8dc-9218-41ad-8a5b-8481327b00e9]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:42 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca Sep 01 01:52:42 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:42 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca" returned: 0 in 0.406s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f82ca1f0-fabb-431e-b001-7622da2b8b03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ae849c-155c-416d-b963-75f83682cb13]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:52:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:42 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 Sep 01 01:52:42 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:43 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03" returned: 0 in 0.450s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:52:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:52:43 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:52:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:43 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f Sep 01 01:52:43 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:49 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f" returned: 0 in 6.245s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:52:49 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Converted 1024.00 MB image at 163.92 MB/s Sep 01 01:52:49 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f is being set with open permissions: ugo+rw Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:52:49 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f Sep 01 01:52:49 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:52:49 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-a9a7c0ed-827b-41ed-b199-82194ffb881f" released by "_copy_volume_from_snapshot" :: held 7.449s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-881d6e0c-8263-4fc9-b468-c2263a2237ca-a9a7c0ed-827b-41ed-b199-82194ffb881f" released by "_create_volume_from_snapshot" :: held 7.530s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.547s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3726d1d6-ebd4-4ece-b5f7-71cc71336a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a7c0ed-827b-41ed-b199-82194ffb881f', 'volume_size': 1, 'snapshot_id': '881d6e0c-8263-4fc9-b468-c2263a2237ca'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb52323-2d4b-4e65-98be-b74b37e0a96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:52:49 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Volume volume-a9a7c0ed-827b-41ed-b199-82194ffb881f (a9a7c0ed-827b-41ed-b199-82194ffb881f): created successfully Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb52323-2d4b-4e65-98be-b74b37e0a96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:52:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Flow 'volume_create_manager' (fefc2885-f36e-4d3f-9d01-068f583e68e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:52:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d49d29a3-b9f4-4438-ae84-89ffdd4b3b8e tempest-TestStampPattern-1951739022 None] Created volume successfully. Sep 01 01:52:59 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:52:59 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Flow 'volume_create_manager' (758d54ed-49ae-4a0f-baf3-f5e28752f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18633ada-5158-4e63-9439-a78aecf150c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18633ada-5158-4e63-9439-a78aecf150c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-531728359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9656419-f1aa-4b08-a965-9c91358fa92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470f58ec7d74a298913fc5086bd03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:53:04Z,use_quota=True,user_id='cdae86e6a3a3442b9f7baa476162c124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3df0dc7d-7f8c-44f4-9a46-a89a5e6e8b72),volume_type_id=3df0dc7d-7f8c-44f4-9a46-a89a5e6e8b72)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336cc512-19b4-4e04-8779-5fe835702a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336cc512-19b4-4e04-8779-5fe835702a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c7f05-f00b-4ada-8efb-0ed10e64b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035c7f05-f00b-4ada-8efb-0ed10e64b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9656419-f1aa-4b08-a965-9c91358fa92a', 'volume_name': 'volume-f9656419-f1aa-4b08-a965-9c91358fa92a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528e67c3-3647-446f-886a-7c572a462020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (528e67c3-3647-446f-886a-7c572a462020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf28701-f441-4e92-ad49-18c3d0037741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Volume f9656419-f1aa-4b08-a965-9c91358fa92a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9656419-f1aa-4b08-a965-9c91358fa92a', 'volume_size': 1} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-531728359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9656419-f1aa-4b08-a965-9c91358fa92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470f58ec7d74a298913fc5086bd03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:53:04Z,use_quota=True,user_id='cdae86e6a3a3442b9f7baa476162c124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3df0dc7d-7f8c-44f4-9a46-a89a5e6e8b72),volume_type_id=3df0dc7d-7f8c-44f4-9a46-a89a5e6e8b72)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Creating volume f9656419-f1aa-4b08-a965-9c91358fa92a {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:53:04 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:04 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a 1073741824 Sep 01 01:53:04 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Flow 'volume_create_manager' (614284c8-88a9-42c9-ae86-0f132ae3dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0853dbc-040e-412b-ba57-6fa798f0db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0853dbc-040e-412b-ba57-6fa798f0db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1716483395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ad7a3-b06f-429b-961e-4729769aeca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470f58ec7d74a298913fc5086bd03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:53:05Z,use_quota=True,user_id='cdae86e6a3a3442b9f7baa476162c124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2914f8a1-8e14-446b-83da-32ed993eb652),volume_type_id=2914f8a1-8e14-446b-83da-32ed993eb652)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176b8ddd-beb4-4e77-ac31-ad7973a723a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176b8ddd-beb4-4e77-ac31-ad7973a723a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd1ffcf-5701-405f-908a-dae09fb8d479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd1ffcf-5701-405f-908a-dae09fb8d479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213ad7a3-b06f-429b-961e-4729769aeca0', 'volume_name': 'volume-213ad7a3-b06f-429b-961e-4729769aeca0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286c4925-4b8f-4065-be2a-d36b45f8da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286c4925-4b8f-4065-be2a-d36b45f8da8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2b70af-808c-4354-a771-1bc861ad004c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Volume 213ad7a3-b06f-429b-961e-4729769aeca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213ad7a3-b06f-429b-961e-4729769aeca0', 'volume_size': 1} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:04 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a 1073741824" returned: 0 in 0.561s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:04 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a Sep 01 01:53:04 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:05 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a" returned: 0 in 0.248s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.398s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1716483395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213ad7a3-b06f-429b-961e-4729769aeca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470f58ec7d74a298913fc5086bd03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:53:05Z,use_quota=True,user_id='cdae86e6a3a3442b9f7baa476162c124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2914f8a1-8e14-446b-83da-32ed993eb652),volume_type_id=2914f8a1-8e14-446b-83da-32ed993eb652)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Creating volume 213ad7a3-b06f-429b-961e-4729769aeca0 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:53:05 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf28701-f441-4e92-ad49-18c3d0037741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9656419-f1aa-4b08-a965-9c91358fa92a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257516b3-5423-4582-8a4a-08687d4d6c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:05 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 1073741824 Sep 01 01:53:05 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:05 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Volume volume-f9656419-f1aa-4b08-a965-9c91358fa92a (f9656419-f1aa-4b08-a965-9c91358fa92a): created successfully Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257516b3-5423-4582-8a4a-08687d4d6c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Flow 'volume_create_manager' (758d54ed-49ae-4a0f-baf3-f5e28752f84b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:53:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6f7fedbb-f994-4bc1-9fe7-5bceeb4941a9 tempest-TestInstancesWithCinderVolumes-664204932 None] Created volume successfully. Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Flow 'volume_create_manager' (f4549e7d-3165-4462-a161-b17ca88467d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91080142-765f-48b8-817e-a39b2c07d117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91080142-765f-48b8-817e-a39b2c07d117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1635677621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1e1f3d-7075-42a0-b877-7f2501e5eb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470f58ec7d74a298913fc5086bd03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:53:05Z,use_quota=True,user_id='cdae86e6a3a3442b9f7baa476162c124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b39cc4b6-e1e4-4613-97c3-97a35b05c500),volume_type_id=b39cc4b6-e1e4-4613-97c3-97a35b05c500)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf88efd9-b9d9-49bf-aff7-183ff60ddcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf88efd9-b9d9-49bf-aff7-183ff60ddcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56de3cc-98d0-4971-9305-8dcb9258ea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c56de3cc-98d0-4971-9305-8dcb9258ea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c1e1f3d-7075-42a0-b877-7f2501e5eb15', 'volume_name': 'volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15', 'volume_size': 1, 'image_id': 'e33ef548-8a03-479c-9f14-ed0643838b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e33ef548-8a03-479c-9f14-ed0643838b1d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1310715547', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8470f58ec7d74a298913fc5086bd03fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e33ef548-8a03-479c-9f14-ed0643838b1d', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e33ef548-8a03-479c-9f14-ed0643838b1d/file', 'properties': {}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497fc6be-ae0a-410d-9d5f-751f4f8562b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497fc6be-ae0a-410d-9d5f-751f4f8562b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac2ae1-6d82-46ce-a46a-2365be633c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:05 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Volume 6c1e1f3d-7075-42a0-b877-7f2501e5eb15: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15', 'volume_size': 1, 'image_id': 'e33ef548-8a03-479c-9f14-ed0643838b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e33ef548-8a03-479c-9f14-ed0643838b1d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1310715547', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8470f58ec7d74a298913fc5086bd03fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e33ef548-8a03-479c-9f14-ed0643838b1d', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e33ef548-8a03-479c-9f14-ed0643838b1d/file', 'properties': {}}, 'image_service': } Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Trying to clone 6c1e1f3d-7075-42a0-b877-7f2501e5eb15 from image e33ef548-8a03-479c-9f14-ed0643838b1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e33ef548-8a03-479c-9f14-ed0643838b1d', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:53:05 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 1073741824" returned: 0 in 0.416s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:05 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 Sep 01 01:53:05 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:05 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0" returned: 0 in 0.246s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2b70af-808c-4354-a771-1bc861ad004c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213ad7a3-b06f-429b-961e-4729769aeca0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730a3a1c-1bc5-4a14-b092-804703b14b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:05 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Volume volume-213ad7a3-b06f-429b-961e-4729769aeca0 (213ad7a3-b06f-429b-961e-4729769aeca0): created successfully Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730a3a1c-1bc5-4a14-b092-804703b14b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Flow 'volume_create_manager' (614284c8-88a9-42c9-ae86-0f132ae3dc88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:53:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6c83e2dd-5f11-4fb1-a3a2-78b9635189bd tempest-TestInstancesWithCinderVolumes-664204932 None] Created volume successfully. Sep 01 01:53:08 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD, size 20.69 MB, duration 2.76 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:53:08 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Image download 20.69 MB at 7.48 MB/s Sep 01 01:53:08 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c11046-0983-455d-897a-ecf24f112341]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:08 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD Sep 01 01:53:08 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:08 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:08 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Temporary image e33ef548-8a03-479c-9f14-ed0643838b1d is fetched for user cdae86e6a3a3442b9f7baa476162c124. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:53:08 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee9281a-09d7-4d37-a7a0-d3c1a1ea944c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:08 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD Sep 01 01:53:08 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:09 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1635677621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1e1f3d-7075-42a0-b877-7f2501e5eb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470f58ec7d74a298913fc5086bd03fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:53:05Z,use_quota=True,user_id='cdae86e6a3a3442b9f7baa476162c124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b39cc4b6-e1e4-4613-97c3-97a35b05c500),volume_type_id=b39cc4b6-e1e4-4613-97c3-97a35b05c500)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Creating volume 6c1e1f3d-7075-42a0-b877-7f2501e5eb15 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:53:09 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:09 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 1073741824 Sep 01 01:53:09 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:09 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 1073741824" returned: 0 in 0.425s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:09 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 Sep 01 01:53:09 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:09 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15" returned: 0 in 0.237s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Attempting download of e33ef548-8a03-479c-9f14-ed0643838b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/e33ef548-8a03-479c-9f14-ed0643838b1d', 'metadata': {}}])) to volume 6c1e1f3d-7075-42a0-b877-7f2501e5eb15. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc7745-e92d-423c-8a8f-bcbfaebbb352]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e33ef548-8a03-479c-9f14-ed0643838b1d_cmdg3e37 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:09 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e33ef548-8a03-479c-9f14-ed0643838b1d_cmdg3e37 Sep 01 01:53:09 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:10 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e33ef548-8a03-479c-9f14-ed0643838b1d_cmdg3e37" returned: 0 in 0.336s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e33ef548-8a03-479c-9f14-ed0643838b1d_cmdg3e37 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:10 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e33ef548-8a03-479c-9f14-ed0643838b1d_cmdg3e37 Sep 01 01:53:10 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:10 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e33ef548-8a03-479c-9f14-ed0643838b1d_cmdg3e37" returned: 1 in 0.315s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e33ef548-8a03-479c-9f14-ed0643838b1d_cmdg3e37' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9ab0f1-39f7-497c-964e-b55e6a270caa]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:10 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD Sep 01 01:53:10 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:10 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] e33ef548-8a03-479c-9f14-ed0643838b1d was qcow2, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:53:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:10 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 Sep 01 01:53:10 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:12 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15" returned: 0 in 1.548s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e33ef548-8a03-479c-9f14-ed0643838b1d_83m1el51devstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:53:12 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Converted 112.00 MB image at 72.30 MB/s Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:12 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 1G Sep 01 01:53:12 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:12 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 1G" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Downloaded image e33ef548-8a03-479c-9f14-ed0643838b1d ((None, [{'url': 'file:///opt/stack/data/glance/images/e33ef548-8a03-479c-9f14-ed0643838b1d', 'metadata': {}}])) to volume 6c1e1f3d-7075-42a0-b877-7f2501e5eb15 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Temporary image e33ef548-8a03-479c-9f14-ed0643838b1d for user cdae86e6a3a3442b9f7baa476162c124 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Marking volume 6c1e1f3d-7075-42a0-b877-7f2501e5eb15 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Copying metadata from image e33ef548-8a03-479c-9f14-ed0643838b1d to 6c1e1f3d-7075-42a0-b877-7f2501e5eb15. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Creating volume glance metadata for volume 6c1e1f3d-7075-42a0-b877-7f2501e5eb15 backed by image e33ef548-8a03-479c-9f14-ed0643838b1d with: {'image_id': 'e33ef548-8a03-479c-9f14-ed0643838b1d', 'image_name': 'tempest-scenario-img--1310715547', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eac2ae1-6d82-46ce-a46a-2365be633c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15', 'volume_size': 1, 'image_id': 'e33ef548-8a03-479c-9f14-ed0643838b1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e33ef548-8a03-479c-9f14-ed0643838b1d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1310715547', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8470f58ec7d74a298913fc5086bd03fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e33ef548-8a03-479c-9f14-ed0643838b1d', 'created_at': datetime.datetime(2026, 8, 31, 23, 53, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 53, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e33ef548-8a03-479c-9f14-ed0643838b1d/file', 'properties': {}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e49007-f779-4baf-b0e7-840bba72ceac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:12 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Volume volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 (6c1e1f3d-7075-42a0-b877-7f2501e5eb15): created successfully Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e49007-f779-4baf-b0e7-840bba72ceac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Flow 'volume_create_manager' (f4549e7d-3165-4462-a161-b17ca88467d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:53:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4af71594-3cf3-46fd-ba44-4c9c41010541 tempest-TestInstancesWithCinderVolumes-664204932 None] Created volume successfully. Sep 01 01:53:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-40931868-8967-4933-b146-2d955089ad1d req-9df796d1-7a07-4915-babe-c4dcf6cfba2a tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-40931868-8967-4933-b146-2d955089ad1d req-9df796d1-7a07-4915-babe-c4dcf6cfba2a tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-40931868-8967-4933-b146-2d955089ad1d req-9df796d1-7a07-4915-babe-c4dcf6cfba2a tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-40931868-8967-4933-b146-2d955089ad1d req-9df796d1-7a07-4915-babe-c4dcf6cfba2a tempest-TestInstancesWithCinderVolumes-664204932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ed459ce-e73a-4067-a594-8a0ca4f5c14f', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:53:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-40931868-8967-4933-b146-2d955089ad1d req-9df796d1-7a07-4915-babe-c4dcf6cfba2a tempest-TestInstancesWithCinderVolumes-664204932 None] attachment_update completed successfully. Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:17 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:53:17 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:17 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.270s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:53:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:53:25 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:INSERT=6 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:53:25 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=12,cinder:SELECT=19,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:53:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-69c434fe-b990-47ea-a933-28f0da7dfffb req-16d0d5c7-360b-4dd9-97b8-c8c0ade930f7 tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-69c434fe-b990-47ea-a933-28f0da7dfffb req-16d0d5c7-360b-4dd9-97b8-c8c0ade930f7 tempest-TestStampPattern-1951739022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-69c434fe-b990-47ea-a933-28f0da7dfffb req-16d0d5c7-360b-4dd9-97b8-c8c0ade930f7 tempest-TestStampPattern-1951739022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-69c434fe-b990-47ea-a933-28f0da7dfffb req-16d0d5c7-360b-4dd9-97b8-c8c0ade930f7 tempest-TestStampPattern-1951739022 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-a9a7c0ed-827b-41ed-b199-82194ffb881f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bb80bb6-021d-43e7-aedd-33d6442bc9ea', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:53:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-69c434fe-b990-47ea-a933-28f0da7dfffb req-16d0d5c7-360b-4dd9-97b8-c8c0ade930f7 tempest-TestStampPattern-1951739022 None] attachment_update completed successfully. Sep 01 01:53:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-03fc9e3b-59d1-435f-9bd5-82a76c881e8d req-04bc93f8-560a-413a-a754-8dcba695e62b tempest-TestStampPattern-1951739022 None] Terminate volume connection completed successfully. Sep 01 01:53:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-03fc9e3b-59d1-435f-9bd5-82a76c881e8d req-04bc93f8-560a-413a-a754-8dcba695e62b tempest-TestStampPattern-1951739022 None] Deleting attachment 3bb80bb6-021d-43e7-aedd-33d6442bc9ea. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-a9a7c0ed-827b-41ed-b199-82194ffb881f-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Lock "cinder-a9a7c0ed-827b-41ed-b199-82194ffb881f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-quobyte-a9a7c0ed-827b-41ed-b199-82194ffb881f" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-a9a7c0ed-827b-41ed-b199-82194ffb881f" acquired by "delete_volume" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18570f4-4511-45c3-921f-650e4e9face3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f Sep 01 01:53:39 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:39 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f" returned: 0 in 0.342s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f Sep 01 01:53:39 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:39 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a9a7c0ed-827b-41ed-b199-82194ffb881f" returned: 0 in 0.242s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-a9a7c0ed-827b-41ed-b199-82194ffb881f" released by "delete_volume" :: held 0.622s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Created reservations ['9feac86a-10ff-4876-841c-d967285dd6c7', 'b18a8070-67a5-43b4-905f-6337c84bc5a4', 'b9248661-ebac-4b5e-b5cd-67884be058c2', 'c5296733-7038-4769-bf9a-e82793a162d7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:39 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:53:39 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:40 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.227s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:53:40 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Deleted volume successfully. Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0392f07c-cc65-40df-827a-1146ddd05233 tempest-TestStampPattern-1951739022 None] Lock "cinder-a9a7c0ed-827b-41ed-b199-82194ffb881f-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-881d6e0c-8263-4fc9-b468-c2263a2237ca-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Lock "cinder-881d6e0c-8263-4fc9-b468-c2263a2237ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-quobyte-f82ca1f0-fabb-431e-b001-7622da2b8b03" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-f82ca1f0-fabb-431e-b001-7622da2b8b03" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-quobyte-881d6e0c-8263-4fc9-b468-c2263a2237ca" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-881d6e0c-8263-4fc9-b468-c2263a2237ca" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Deleting offline snapshot 881d6e0c-8263-4fc9-b468-c2263a2237ca of volume f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] snapshot_file for this snap is: volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0329aab-8f44-4479-977e-ab4866acd00b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:40 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca Sep 01 01:53:40 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:40 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca" returned: 0 in 0.345s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f82ca1f0-fabb-431e-b001-7622da2b8b03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b914ab-0f25-4479-acd8-3080b5a37f03]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:41 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 Sep 01 01:53:41 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:41 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03" returned: 0 in 0.482s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:41 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca Sep 01 01:53:41 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:41 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:41 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca Sep 01 01:53:41 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:41 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03.881d6e0c-8263-4fc9-b468-c2263a2237ca" returned: 0 in 0.229s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-881d6e0c-8263-4fc9-b468-c2263a2237ca" released by "_delete_snapshot" :: held 1.448s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-f82ca1f0-fabb-431e-b001-7622da2b8b03" released by "delete_snapshot" :: held 1.467s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:42 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Created reservations ['4ed33842-cd22-4e9b-ad7e-2cd61d9adf4b', 'd33c5f16-fb87-41e6-a8c1-3f1775eb56ff', 'ec813a5b-d917-4d6a-a89e-5249e3a115af', '6c5ad3f3-868c-46a5-b27c-8aafb8325134'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:53:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Delete snapshot completed successfully. Sep 01 01:53:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6355abc0-629e-4a2d-9f32-58712125b763 tempest-TestStampPattern-1951739022 None] Lock "cinder-881d6e0c-8263-4fc9-b468-c2263a2237ca-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-f82ca1f0-fabb-431e-b001-7622da2b8b03-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Lock "cinder-f82ca1f0-fabb-431e-b001-7622da2b8b03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Acquiring lock "cinder-quobyte-f82ca1f0-fabb-431e-b001-7622da2b8b03" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-f82ca1f0-fabb-431e-b001-7622da2b8b03" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac26c57b-3eeb-4bbe-8bf1-baba55729cff]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:46 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 Sep 01 01:53:46 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:46 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03" returned: 0 in 0.364s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:46 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03 Sep 01 01:53:46 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:46 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f82ca1f0-fabb-431e-b001-7622da2b8b03" returned: 0 in 0.254s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Lock "cinder-quobyte-f82ca1f0-fabb-431e-b001-7622da2b8b03" released by "delete_volume" :: held 0.681s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:46 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Created reservations ['12b7c48a-3493-4e90-a3cd-68229651114f', 'c11bc375-5b00-4623-b576-ecf30b5f7019', 'c87e581d-1552-4b6e-b92b-cfb36f07767f', '5c8f4289-39a2-4176-8a7b-092fe3de48f8'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:47 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:53:47 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:47 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.280s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:53:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Deleted volume successfully. Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-37445939-86f7-434c-909b-2c084d95190f req-cf510de9-f981-415b-af9e-270af2bff2d5 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-37445939-86f7-434c-909b-2c084d95190f req-cf510de9-f981-415b-af9e-270af2bff2d5 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-37445939-86f7-434c-909b-2c084d95190f req-cf510de9-f981-415b-af9e-270af2bff2d5 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-27a3a004-6f12-494e-ba37-fb05e49f2fc0 tempest-TestStampPattern-1951739022 None] Lock "cinder-f82ca1f0-fabb-431e-b001-7622da2b8b03-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-37445939-86f7-434c-909b-2c084d95190f req-cf510de9-f981-415b-af9e-270af2bff2d5 tempest-TestInstancesWithCinderVolumes-664204932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-f9656419-f1aa-4b08-a965-9c91358fa92a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c0dd024-4c18-461d-9349-f3ec5718c03b', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:53:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-37445939-86f7-434c-909b-2c084d95190f req-cf510de9-f981-415b-af9e-270af2bff2d5 tempest-TestInstancesWithCinderVolumes-664204932 None] attachment_update completed successfully. Sep 01 01:53:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-7e82d94c-b8ca-4e6e-86d6-171cab1b20a8 req-d52da80e-390d-46b8-9751-a98a8cafc9c7 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-7e82d94c-b8ca-4e6e-86d6-171cab1b20a8 req-d52da80e-390d-46b8-9751-a98a8cafc9c7 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-7e82d94c-b8ca-4e6e-86d6-171cab1b20a8 req-d52da80e-390d-46b8-9751-a98a8cafc9c7 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:49 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-7e82d94c-b8ca-4e6e-86d6-171cab1b20a8 req-d52da80e-390d-46b8-9751-a98a8cafc9c7 tempest-TestInstancesWithCinderVolumes-664204932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-213ad7a3-b06f-429b-961e-4729769aeca0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c103c1b6-d2d4-4355-8ba2-c522ec1e29d1', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:53:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-7e82d94c-b8ca-4e6e-86d6-171cab1b20a8 req-d52da80e-390d-46b8-9751-a98a8cafc9c7 tempest-TestInstancesWithCinderVolumes-664204932 None] attachment_update completed successfully. Sep 01 01:53:54 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-a3109a8a-1d07-49b4-856b-f8410fe70777 req-dbe663da-05b7-4290-8a60-89ba8d14fd64 tempest-TestInstancesWithCinderVolumes-664204932 None] Terminate volume connection completed successfully. Sep 01 01:53:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-a3109a8a-1d07-49b4-856b-f8410fe70777 req-dbe663da-05b7-4290-8a60-89ba8d14fd64 tempest-TestInstancesWithCinderVolumes-664204932 None] Deleting attachment 8c0dd024-4c18-461d-9349-f3ec5718c03b. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:53:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "cinder-f9656419-f1aa-4b08-a965-9c91358fa92a-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-f9656419-f1aa-4b08-a965-9c91358fa92a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "cinder-quobyte-f9656419-f1aa-4b08-a965-9c91358fa92a" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-quobyte-f9656419-f1aa-4b08-a965-9c91358fa92a" acquired by "delete_volume" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:54 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a9352-1300-4865-a727-d08ae100285c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:54 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a Sep 01 01:53:54 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:55 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a" returned: 0 in 0.355s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:55 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a Sep 01 01:53:55 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:55 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9656419-f1aa-4b08-a965-9c91358fa92a" returned: 0 in 0.265s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-quobyte-f9656419-f1aa-4b08-a965-9c91358fa92a" released by "delete_volume" :: held 0.659s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:55 devstack cinder-volume[87212]: WARNING cinder.quota [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102381189-1037935459 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102381189-1037935459, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:53:55 devstack cinder-volume[87212]: WARNING cinder.quota [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102381189-1037935459 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1102381189-1037935459, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Created reservations ['52cab827-9b90-4aab-b27a-530047e37b5f', '250332d4-a5cc-4939-bfa8-1c7d20ea3680', '35431138-b49c-44f7-ae81-516079266510', '833851c0-fac7-45d2-8341-65c68898de81'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:55 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:53:55 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:55 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.299s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:53:55 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:53:55 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Deleted volume successfully. Sep 01 01:53:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-85cc26f3-afd9-4e0f-8072-0204f1711ceb tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-f9656419-f1aa-4b08-a965-9c91358fa92a-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:53:58 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-7e921e9b-7952-4974-bc31-afca00ff6c2d req-44768ce2-84df-43b3-aaaf-b5a7105c8a0f tempest-TestInstancesWithCinderVolumes-664204932 None] Terminate volume connection completed successfully. Sep 01 01:53:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-7e921e9b-7952-4974-bc31-afca00ff6c2d req-44768ce2-84df-43b3-aaaf-b5a7105c8a0f tempest-TestInstancesWithCinderVolumes-664204932 None] Deleting attachment c103c1b6-d2d4-4355-8ba2-c522ec1e29d1. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "cinder-213ad7a3-b06f-429b-961e-4729769aeca0-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-213ad7a3-b06f-429b-961e-4729769aeca0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "cinder-quobyte-213ad7a3-b06f-429b-961e-4729769aeca0" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-quobyte-213ad7a3-b06f-429b-961e-4729769aeca0" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff04ecf2-b9f0-448f-b955-20d9bf866591]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:53:59 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 Sep 01 01:53:59 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Flow 'volume_create_manager' (3e9e9cf5-c929-4804-999c-3baae6f4d664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a48a11-a50c-4d55-878c-7bfc97ac20ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a48a11-a50c-4d55-878c-7bfc97ac20ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1268664846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646db99b-35da-474e-86a4-6efbd6f5a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f84a11b188408b8bbbc4b16767c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:54:00Z,use_quota=True,user_id='62cdda92c5c949ee89f5a63d0bcc7667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c6f90d-58e2-40cb-8af8-1c59e4131f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c6f90d-58e2-40cb-8af8-1c59e4131f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16e4245-18d3-4ae8-8d7f-11d586c3d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16e4245-18d3-4ae8-8d7f-11d586c3d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646db99b-35da-474e-86a4-6efbd6f5a4af', 'volume_name': 'volume-646db99b-35da-474e-86a4-6efbd6f5a4af', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:53:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed8515d-6234-4ca6-8ce8-e60c73a2f828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed8515d-6234-4ca6-8ce8-e60c73a2f828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69106c34-96d6-4f82-8be7-50fc0b17cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:00 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Volume 646db99b-35da-474e-86a4-6efbd6f5a4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646db99b-35da-474e-86a4-6efbd6f5a4af', 'volume_size': 1} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:00 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1268664846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646db99b-35da-474e-86a4-6efbd6f5a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f84a11b188408b8bbbc4b16767c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:54:00Z,use_quota=True,user_id='62cdda92c5c949ee89f5a63d0bcc7667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Creating volume 646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:54:00 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0" returned: 0 in 0.482s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:00 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af 1073741824 Sep 01 01:54:00 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:00 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0 Sep 01 01:54:00 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:00 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-213ad7a3-b06f-429b-961e-4729769aeca0" returned: 0 in 0.275s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-quobyte-213ad7a3-b06f-429b-961e-4729769aeca0" released by "delete_volume" :: held 0.805s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:00 devstack cinder-volume[87212]: WARNING cinder.quota [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-508551752-1903495914 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-508551752-1903495914, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:54:00 devstack cinder-volume[87212]: WARNING cinder.quota [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-508551752-1903495914 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-508551752-1903495914, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Created reservations ['9c2da32b-936e-470c-a71c-649aff64ef22', 'fe59f633-2023-40d4-9f81-6d7381579846', '601889c2-fd5c-4c1a-adb0-e620c4230a38', 'fffccf13-d579-451e-a399-59b250494709'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:00 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:54:00 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:00 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af 1073741824" returned: 0 in 0.506s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:00 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af Sep 01 01:54:00 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:00 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.268s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:00 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Deleted volume successfully. Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-bc0e1dd2-4c5c-4016-ada8-8c24d92cb747 tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-213ad7a3-b06f-429b-961e-4729769aeca0-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:00 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69106c34-96d6-4f82-8be7-50fc0b17cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646db99b-35da-474e-86a4-6efbd6f5a4af', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f9d26f-fc0b-4555-b07a-3c18f99bd3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:00 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Volume volume-646db99b-35da-474e-86a4-6efbd6f5a4af (646db99b-35da-474e-86a4-6efbd6f5a4af): created successfully Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f9d26f-fc0b-4555-b07a-3c18f99bd3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Flow 'volume_create_manager' (3e9e9cf5-c929-4804-999c-3baae6f4d664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:54:00 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-08e48a7b-5cb3-4d5e-bd1f-e4ebc69f3015 tempest-VolumeDependencyTests-1440950790 None] Created volume successfully. Sep 01 01:54:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Creating offline snapshot f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 of volume 646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:54:02 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d467cb1-7b65-4c22-bec1-3474b0f30aac]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:02 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af Sep 01 01:54:02 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:02 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af" returned: 0 in 0.511s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:02 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 1G Sep 01 01:54:02 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:03 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-23bdf3d2-fa20-405a-a063-ae1498ff8492 req-fb9ee141-13ba-441f-8e57-23de920d5642 tempest-TestInstancesWithCinderVolumes-664204932 None] Terminate volume connection completed successfully. Sep 01 01:54:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-23bdf3d2-fa20-405a-a063-ae1498ff8492 req-fb9ee141-13ba-441f-8e57-23de920d5642 tempest-TestInstancesWithCinderVolumes-664204932 None] Deleting attachment 1ed459ce-e73a-4067-a594-8a0ca4f5c14f. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:54:03 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 1G" returned: 0 in 0.505s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646db99b-35da-474e-86a4-6efbd6f5a4af -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:03 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646db99b-35da-474e-86a4-6efbd6f5a4af -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 Sep 01 01:54:03 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:03 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646db99b-35da-474e-86a4-6efbd6f5a4af -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" returned: 0 in 0.334s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:03 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 is being set with open permissions: ugo+rw Sep 01 01:54:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:03 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 Sep 01 01:54:03 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:03 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" returned: 0 in 0.253s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:03 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.info Sep 01 01:54:03 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:04 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.info" returned: 0 in 0.229s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:04 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.info is being set with open permissions: ugo+rw Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:04 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.info Sep 01 01:54:04 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:04 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.info" returned: 0 in 0.237s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f98a02b5-541d-483b-adfb-8a9ecd649dd1 tempest-VolumeDependencyTests-1440950790 None] Create snapshot completed successfully Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "cinder-6c1e1f3d-7075-42a0-b877-7f2501e5eb15-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-6c1e1f3d-7075-42a0-b877-7f2501e5eb15-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "cinder-quobyte-6c1e1f3d-7075-42a0-b877-7f2501e5eb15" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-quobyte-6c1e1f3d-7075-42a0-b877-7f2501e5eb15" acquired by "delete_volume" :: waited 0.011s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d9419-3a8c-4cae-ac58-1608bda2a3fe]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:04 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 Sep 01 01:54:04 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15" returned: 0 in 0.371s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:04 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:04 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15 Sep 01 01:54:04 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:05 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6c1e1f3d-7075-42a0-b877-7f2501e5eb15" returned: 0 in 0.228s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-quobyte-6c1e1f3d-7075-42a0-b877-7f2501e5eb15" released by "delete_volume" :: held 0.634s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:05 devstack cinder-volume[87212]: WARNING cinder.quota [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1269058645-1908411793 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1269058645-1908411793, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:54:05 devstack cinder-volume[87212]: WARNING cinder.quota [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1269058645-1908411793 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1269058645-1908411793, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Created reservations ['e63ef799-dc8e-4437-a4ca-bc1bb157f987', '6fca706b-7626-426a-a77a-7e0f74703370', 'a347bc90-0eac-41ca-b276-15699e1cd29a', '2166b53f-bb87-49a6-ae06-06240540ea46'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:05 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:54:05 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:05 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.245s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Deleted volume successfully. Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-346c59aa-d809-41f9-ae0a-1aa8769ca4ab tempest-TestInstancesWithCinderVolumes-664204932 None] Lock "cinder-6c1e1f3d-7075-42a0-b877-7f2501e5eb15-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Flow 'volume_create_manager' (1e3c56e0-3c45-4ca8-af0d-b88e7a52741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0077d74d-17b1-469a-83cb-b61acdf6c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0077d74d-17b1-469a-83cb-b61acdf6c751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-557654027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7e3e5d-ea5e-441e-bd2b-c1169894f328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f84a11b188408b8bbbc4b16767c410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f785fdd3-3bd1-4eac-a652-c122cf6d1ea1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:54:06Z,use_quota=True,user_id='62cdda92c5c949ee89f5a63d0bcc7667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0597a0-0125-486b-a1ea-8deabdaa01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0597a0-0125-486b-a1ea-8deabdaa01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeea458-6571-4c83-acd8-6ddfd3e046d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeea458-6571-4c83-acd8-6ddfd3e046d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac7e3e5d-ea5e-441e-bd2b-c1169894f328', 'volume_name': 'volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328', 'volume_size': 1, 'snapshot_id': 'f785fdd3-3bd1-4eac-a652-c122cf6d1ea1'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2ff7b6-3f0c-4a49-85af-8b5eb5682eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2ff7b6-3f0c-4a49-85af-8b5eb5682eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd95293-5e34-4ed3-a670-6e6b8cd504ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:06 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Volume ac7e3e5d-ea5e-441e-bd2b-c1169894f328: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328', 'volume_size': 1, 'snapshot_id': 'f785fdd3-3bd1-4eac-a652-c122cf6d1ea1'} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-quobyte-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Creating volume ac7e3e5d-ea5e-441e-bd2b-c1169894f328 from snapshot f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-quobyte-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] snapshot: f785fdd3-3bd1-4eac-a652-c122cf6d1ea1, volume: ac7e3e5d-ea5e-441e-bd2b-c1169894f328, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99bf86c-8711-4f6c-ab4d-d153bee45078]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:06 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 Sep 01 01:54:06 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:06 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" returned: 0 in 0.364s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646db99b-35da-474e-86a4-6efbd6f5a4af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cafd37-a0d9-4221-b4f8-a9c9dc68d70b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:06 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af Sep 01 01:54:06 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:06 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:54:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:06 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 Sep 01 01:54:06 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:11 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" returned: 0 in 4.485s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:54:11 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Converted 1024.00 MB image at 228.25 MB/s Sep 01 01:54:11 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 is being set with open permissions: ugo+rw Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:11 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 Sep 01 01:54:11 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:11 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" released by "_copy_volume_from_snapshot" :: held 5.632s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" released by "_create_volume_from_snapshot" :: held 5.700s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.717s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd95293-5e34-4ed3-a670-6e6b8cd504ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328', 'volume_size': 1, 'snapshot_id': 'f785fdd3-3bd1-4eac-a652-c122cf6d1ea1'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88948bd7-cddd-4379-8a04-9b31c133a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Volume volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 (ac7e3e5d-ea5e-441e-bd2b-c1169894f328): created successfully Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88948bd7-cddd-4379-8a04-9b31c133a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Flow 'volume_create_manager' (1e3c56e0-3c45-4ca8-af0d-b88e7a52741a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:54:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2fd461ad-453b-48fd-a103-99af38e662c9 tempest-VolumeDependencyTests-1440950790 None] Created volume successfully. Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-quobyte-646db99b-35da-474e-86a4-6efbd6f5a4af" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-646db99b-35da-474e-86a4-6efbd6f5a4af" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-quobyte-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Deleting offline snapshot f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 of volume 646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] snapshot_file for this snap is: volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5ae73-2fb2-4e70-9751-92199d17d73a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:12 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 Sep 01 01:54:12 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:12 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" returned: 0 in 0.351s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646db99b-35da-474e-86a4-6efbd6f5a4af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6189a750-8850-4dc9-b0dd-436e15c00102]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:13 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af Sep 01 01:54:13 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:13 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af" returned: 0 in 0.521s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:13 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 Sep 01 01:54:13 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:13 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" returned: 0 in 0.311s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:13 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1 Sep 01 01:54:13 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:14 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af.f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" returned: 0 in 0.257s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1" released by "_delete_snapshot" :: held 1.542s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-646db99b-35da-474e-86a4-6efbd6f5a4af" released by "delete_snapshot" :: held 1.569s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Created reservations ['49e3252b-696c-46b6-937a-c52ffd7bc8f3', '1a26e75f-4521-43f8-8496-05b8cf22e325', '56c5bff1-a3b3-4c03-a4ec-28f9c9e5625d', '8828835c-4116-4954-8178-bb83bd72ad06'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:54:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Delete snapshot completed successfully. Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-92794161-b233-46a3-983b-4533e7b1a0bc tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-f785fdd3-3bd1-4eac-a652-c122cf6d1ea1-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-646db99b-35da-474e-86a4-6efbd6f5a4af-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-646db99b-35da-474e-86a4-6efbd6f5a4af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-quobyte-646db99b-35da-474e-86a4-6efbd6f5a4af" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-646db99b-35da-474e-86a4-6efbd6f5a4af" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f683be-dd06-43f7-8ede-48e310297b09]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:14 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af Sep 01 01:54:14 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:15 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af" returned: 0 in 0.441s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:15 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af Sep 01 01:54:15 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:15 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-646db99b-35da-474e-86a4-6efbd6f5a4af" returned: 0 in 0.269s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-646db99b-35da-474e-86a4-6efbd6f5a4af" released by "delete_volume" :: held 0.777s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Created reservations ['2c1882f5-364f-42cc-8b93-fd49f140824b', '553e6d13-7090-46f3-8e7f-d15ed26726a0', 'df67fe75-6276-4f63-858b-a4c72156317d', 'b69288d8-7cd6-4a2a-882d-eddae285dff3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:15 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:54:15 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-ac7e3e5d-ea5e-441e-bd2b-c1169894f328-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-ac7e3e5d-ea5e-441e-bd2b-c1169894f328-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:15 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.251s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Deleted volume successfully. Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "cinder-quobyte-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9394c41d-3551-4d0a-94c5-fb64bed71370 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-646db99b-35da-474e-86a4-6efbd6f5a4af-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" acquired by "delete_volume" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c66fd4-a29f-46bd-b329-9f1e51e4a80a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:16 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 Sep 01 01:54:16 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:16 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" returned: 0 in 0.363s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:16 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328 Sep 01 01:54:16 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:16 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" returned: 0 in 0.316s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-quobyte-ac7e3e5d-ea5e-441e-bd2b-c1169894f328" released by "delete_volume" :: held 0.717s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Created reservations ['a1b5d8b6-c480-4a64-90b3-83b4141340f3', '00125e70-bdb7-4a38-8c51-12427e8b0e44', '46114c81-7332-4e3b-81e7-ab822765dc29', '5a2692c7-44dd-4ff1-86dd-f65b96fbbcf0'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:16 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:54:16 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:17 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.259s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Deleted volume successfully. Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-aca160cd-c31f-4ac8-aa8f-e8ac3a56cf54 tempest-VolumeDependencyTests-1440950790 None] Lock "cinder-ac7e3e5d-ea5e-441e-bd2b-c1169894f328-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:17 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:54:17 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:17 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:54:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:54:26 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=89,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:26 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=69,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Flow 'volume_create_manager' (1ad8239c-0b45-4330-9658-d662323797d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235088a3-cb37-44ab-81de-44c989e20f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235088a3-cb37-44ab-81de-44c989e20f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-463523539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f652bd8-e0f4-4389-8cb2-0d7090be1132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350b514de954ac2951bc7996c161ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:54:43Z,use_quota=True,user_id='def29baa51464d07b73170579c73b2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d60d1f4-1c0c-4228-ac30-5bf2e9e49995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d60d1f4-1c0c-4228-ac30-5bf2e9e49995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb353483-2c7c-4b8d-8ad2-c0989c379124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb353483-2c7c-4b8d-8ad2-c0989c379124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f652bd8-e0f4-4389-8cb2-0d7090be1132', 'volume_name': 'volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517dba76-e5dd-4199-abb5-59297c6b1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517dba76-e5dd-4199-abb5-59297c6b1e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3236af5a-87f8-43c8-857b-45bdd5ce1e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Volume 0f652bd8-e0f4-4389-8cb2-0d7090be1132: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Trying to clone 0f652bd8-e0f4-4389-8cb2-0d7090be1132 from image babec01a-b62a-4774-aa41-a35db0f34a47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:54:43 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Image download 20.69 MB at 20.69 MB/s Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4563620-a2ce-4f5f-828e-dd09e2cf8880]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:44 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD Sep 01 01:54:44 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:44 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD" returned: 0 in 0.305s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 is fetched for user def29baa51464d07b73170579c73b2a6. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[92334bba-e297-4e6e-8ca1-52be9d1f59e6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:44 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD Sep 01 01:54:44 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:44 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD" returned: 0 in 0.310s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-463523539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f652bd8-e0f4-4389-8cb2-0d7090be1132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8350b514de954ac2951bc7996c161ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:54:43Z,use_quota=True,user_id='def29baa51464d07b73170579c73b2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Creating volume 0f652bd8-e0f4-4389-8cb2-0d7090be1132 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:54:44 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:54:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:44 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 1073741824 Sep 01 01:54:44 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:44 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 1073741824" returned: 0 in 0.385s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:45 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 Sep 01 01:54:45 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:45 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132" returned: 0 in 0.232s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] <== create_volume: return (655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Attempting download of babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume 0f652bd8-e0f4-4389-8cb2-0d7090be1132. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd28e8b2-916f-4cf7-9480-1b81acd48fa0]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_d36bq252 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:45 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_d36bq252 Sep 01 01:54:45 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:45 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_d36bq252" returned: 0 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_d36bq252 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:45 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_d36bq252 Sep 01 01:54:45 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:45 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_d36bq252" returned: 1 in 0.325s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_babec01a-b62a-4774-aa41-a35db0f34a47_d36bq252' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90921bc-b9d5-4a68-9fb2-b2eb02585d33]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:54:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:46 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD Sep 01 01:54:46 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:46 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD" returned: 0 in 0.307s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:46 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] babec01a-b62a-4774-aa41-a35db0f34a47 was qcow2, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:54:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:46 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 Sep 01 01:54:46 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:47 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132" returned: 0 in 1.514s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:47 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_babec01a-b62a-4774-aa41-a35db0f34a47_eicbgg44devstack@QuobyteHD, size 112.00 MB, duration 1.52 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:54:47 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Converted 112.00 MB image at 73.91 MB/s Sep 01 01:54:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:47 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 1G Sep 01 01:54:47 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:48 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 1G" returned: 0 in 0.315s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Downloaded image babec01a-b62a-4774-aa41-a35db0f34a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}])) to volume 0f652bd8-e0f4-4389-8cb2-0d7090be1132 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Temporary image babec01a-b62a-4774-aa41-a35db0f34a47 for user def29baa51464d07b73170579c73b2a6 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Marking volume 0f652bd8-e0f4-4389-8cb2-0d7090be1132 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Copying metadata from image babec01a-b62a-4774-aa41-a35db0f34a47 to 0f652bd8-e0f4-4389-8cb2-0d7090be1132. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Creating volume glance metadata for volume 0f652bd8-e0f4-4389-8cb2-0d7090be1132 backed by image babec01a-b62a-4774-aa41-a35db0f34a47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3236af5a-87f8-43c8-857b-45bdd5ce1e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132', 'volume_size': 1, 'image_id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/babec01a-b62a-4774-aa41-a35db0f34a47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '88e62a59022e4d3894ea13bbf9bc816c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'babec01a-b62a-4774-aa41-a35db0f34a47', 'created_at': datetime.datetime(2026, 8, 31, 23, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/babec01a-b62a-4774-aa41-a35db0f34a47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1b9217-4559-495b-b719-852f446c87f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:54:48 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Volume volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 (0f652bd8-e0f4-4389-8cb2-0d7090be1132): created successfully Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1b9217-4559-495b-b719-852f446c87f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:54:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Flow 'volume_create_manager' (1ad8239c-0b45-4330-9658-d662323797d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:54:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-16843ace-b78d-424f-938d-ff6f78466145 tempest-TestShelveInstance-2076687677 None] Created volume successfully. Sep 01 01:54:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-88895ce5-4dc7-4841-b525-10a297e03e81 req-ea13627c-3378-4ab5-acab-0cc9812a5df9 tempest-TestShelveInstance-2076687677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:54:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-88895ce5-4dc7-4841-b525-10a297e03e81 req-ea13627c-3378-4ab5-acab-0cc9812a5df9 tempest-TestShelveInstance-2076687677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:54:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-88895ce5-4dc7-4841-b525-10a297e03e81 req-ea13627c-3378-4ab5-acab-0cc9812a5df9 tempest-TestShelveInstance-2076687677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:54:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-88895ce5-4dc7-4841-b525-10a297e03e81 req-ea13627c-3378-4ab5-acab-0cc9812a5df9 tempest-TestShelveInstance-2076687677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be829799-6f2f-4771-ba55-e01ce4a11d99', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:54:52 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-88895ce5-4dc7-4841-b525-10a297e03e81 req-ea13627c-3378-4ab5-acab-0cc9812a5df9 tempest-TestShelveInstance-2076687677 None] attachment_update completed successfully. Sep 01 01:55:02 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:55:02 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=5,cinder:SELECT=18,cinder:INSERT=7 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:17 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:55:17 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:17 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:55:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:55:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-294c70a6-959a-4e8d-89ac-de321b374db7 req-d29bcc32-cab3-4f5b-9e1b-f8de5127bc22 tempest-TestShelveInstance-2076687677 None] Terminate volume connection completed successfully. Sep 01 01:55:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-294c70a6-959a-4e8d-89ac-de321b374db7 req-d29bcc32-cab3-4f5b-9e1b-f8de5127bc22 tempest-TestShelveInstance-2076687677 None] Deleting attachment be829799-6f2f-4771-ba55-e01ce4a11d99. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:55:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-63db69e0-9cc3-4434-9521-7b6e9ff1779b req-e058c0f6-524f-458f-8229-4e269d5a6d6d tempest-TestShelveInstance-2076687677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:55:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-63db69e0-9cc3-4434-9521-7b6e9ff1779b req-e058c0f6-524f-458f-8229-4e269d5a6d6d tempest-TestShelveInstance-2076687677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:55:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-63db69e0-9cc3-4434-9521-7b6e9ff1779b req-e058c0f6-524f-458f-8229-4e269d5a6d6d tempest-TestShelveInstance-2076687677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:55:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-63db69e0-9cc3-4434-9521-7b6e9ff1779b req-e058c0f6-524f-458f-8229-4e269d5a6d6d tempest-TestShelveInstance-2076687677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1', 'name': 'volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea9bc778-b66d-472b-9ef3-f74ec2c89ba3', 'enforce_multipath': True} {{(pid=87212) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 01:55:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-63db69e0-9cc3-4434-9521-7b6e9ff1779b req-e058c0f6-524f-458f-8229-4e269d5a6d6d tempest-TestShelveInstance-2076687677 None] attachment_update completed successfully. Sep 01 01:55:35 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:55:35 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-03d89f05-3e90-484c-999d-6263020fa2b5 tempest-TestShelveInstance-2076687677 None] Terminate volume connection completed successfully. Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-03d89f05-3e90-484c-999d-6263020fa2b5 tempest-TestShelveInstance-2076687677 None] Deleting attachment ea9bc778-b66d-472b-9ef3-f74ec2c89ba3. {{(pid=87212) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Acquiring lock "cinder-0f652bd8-e0f4-4389-8cb2-0d7090be1132-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Lock "cinder-0f652bd8-e0f4-4389-8cb2-0d7090be1132-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Acquiring lock "cinder-quobyte-0f652bd8-e0f4-4389-8cb2-0d7090be1132" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Lock "cinder-quobyte-0f652bd8-e0f4-4389-8cb2-0d7090be1132" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc7db56-2f39-42ef-9125-764d63cd86ba]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:09 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 Sep 01 01:56:09 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:09 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132" returned: 0 in 0.369s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:09 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132 Sep 01 01:56:09 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:10 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0f652bd8-e0f4-4389-8cb2-0d7090be1132" returned: 0 in 0.240s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Lock "cinder-quobyte-0f652bd8-e0f4-4389-8cb2-0d7090be1132" released by "delete_volume" :: held 0.651s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG cinder.quota [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Created reservations ['2c0fbf1c-88a0-425d-9c61-f8e147223228', '45de6f3a-6f1a-453b-b9e6-a7f6e44f7ebe', 'b439589e-2ee3-4972-ad8c-8654753b6270', '3fd6d17e-5c67-4eef-b93d-702d3e36f18d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:10 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:10 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:10 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.276s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG cinder.manager [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Deleted volume successfully. Sep 01 01:56:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [req-0b48e629-9a84-4d6f-b1ca-988e5fd0d7fe req-11bce8f3-8e1c-4373-b5e1-1a97e9cd438f tempest-TestShelveInstance-2076687677 None] Lock "cinder-0f652bd8-e0f4-4389-8cb2-0d7090be1132-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:17 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:17 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:17 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.243s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:56:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:56:20 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:20 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Flow 'volume_create_manager' (cd23f79b-a509-4e45-b260-9adbce3ddc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c42ac44-7375-4455-8b2a-b0a9e11d89c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c42ac44-7375-4455-8b2a-b0a9e11d89c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5cf4f7-1cf1-455c-a23a-93572b773ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b59109cc7645798fd2d6737fdb6cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:25Z,use_quota=True,user_id='70bd47309b23426f9d8dec8506d11080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(166118a8-f7b2-4c99-b70f-44106c8dad0d),volume_type_id=166118a8-f7b2-4c99-b70f-44106c8dad0d)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5c155a-1738-4951-b5bb-cd128979b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5c155a-1738-4951-b5bb-cd128979b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8825b046-3c81-4efb-92b2-be1715b85dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8825b046-3c81-4efb-92b2-be1715b85dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc5cf4f7-1cf1-455c-a23a-93572b773ff2', 'volume_name': 'volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2', 'volume_size': 1, 'image_id': '1f5440bc-a155-4edf-b38b-4a05980bc72e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f5440bc-a155-4edf-b38b-4a05980bc72e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd1a181a3001f30e690abfc8b1ef57b67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26b59109cc7645798fd2d6737fdb6cd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd847ecf439f8836fec5c33c30c82601054969241e67c0d926ce84d6e39c5237116f8559bb953c923093531d606ceb34aaa412cb84da84cda85520b71da71c11b', 'id': '1f5440bc-a155-4edf-b38b-4a05980bc72e', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f5440bc-a155-4edf-b38b-4a05980bc72e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424701bd-df8a-4455-8de6-25e5132644e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424701bd-df8a-4455-8de6-25e5132644e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c53962-7713-4444-967d-1d4daf8d30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:25 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Volume cc5cf4f7-1cf1-455c-a23a-93572b773ff2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2', 'volume_size': 1, 'image_id': '1f5440bc-a155-4edf-b38b-4a05980bc72e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f5440bc-a155-4edf-b38b-4a05980bc72e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd1a181a3001f30e690abfc8b1ef57b67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26b59109cc7645798fd2d6737fdb6cd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd847ecf439f8836fec5c33c30c82601054969241e67c0d926ce84d6e39c5237116f8559bb953c923093531d606ceb34aaa412cb84da84cda85520b71da71c11b', 'id': '1f5440bc-a155-4edf-b38b-4a05980bc72e', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f5440bc-a155-4edf-b38b-4a05980bc72e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Trying to clone cc5cf4f7-1cf1-455c-a23a-93572b773ff2 from image 1f5440bc-a155-4edf-b38b-4a05980bc72e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f5440bc-a155-4edf-b38b-4a05980bc72e', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:56:25 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c44a762-ecb7-4564-a4a0-f0c62bf3111f]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:25 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD Sep 01 01:56:25 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:25 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:26 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD Sep 01 01:56:26 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:26 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Temporary image 1f5440bc-a155-4edf-b38b-4a05980bc72e is fetched for user 70bd47309b23426f9d8dec8506d11080. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1114adae-b32e-41ad-a16b-e077fc4b1d66]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:26 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD Sep 01 01:56:26 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:26 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:26 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD Sep 01 01:56:26 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:26 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5cf4f7-1cf1-455c-a23a-93572b773ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b59109cc7645798fd2d6737fdb6cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:25Z,use_quota=True,user_id='70bd47309b23426f9d8dec8506d11080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(166118a8-f7b2-4c99-b70f-44106c8dad0d),volume_type_id=166118a8-f7b2-4c99-b70f-44106c8dad0d)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Creating volume cc5cf4f7-1cf1-455c-a23a-93572b773ff2 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:26 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:26 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 1073741824 Sep 01 01:56:26 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:27 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 1073741824" returned: 0 in 0.411s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:27 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 Sep 01 01:56:27 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:27 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2" returned: 0 in 0.234s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Attempting download of 1f5440bc-a155-4edf-b38b-4a05980bc72e ((None, [{'url': 'file:///opt/stack/data/glance/images/1f5440bc-a155-4edf-b38b-4a05980bc72e', 'metadata': {}}])) to volume cc5cf4f7-1cf1-455c-a23a-93572b773ff2. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2698e9d-00c3-4ee9-85a5-3f2631dfeea7]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f5440bc-a155-4edf-b38b-4a05980bc72e_to1qty3d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:27 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f5440bc-a155-4edf-b38b-4a05980bc72e_to1qty3d Sep 01 01:56:27 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:28 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f5440bc-a155-4edf-b38b-4a05980bc72e_to1qty3d" returned: 0 in 0.307s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f5440bc-a155-4edf-b38b-4a05980bc72e_to1qty3d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:28 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f5440bc-a155-4edf-b38b-4a05980bc72e_to1qty3d Sep 01 01:56:28 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:28 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f5440bc-a155-4edf-b38b-4a05980bc72e_to1qty3d" returned: 1 in 0.333s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f5440bc-a155-4edf-b38b-4a05980bc72e_to1qty3d' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d1eb2f-6319-48bc-9c6c-90eb52203393]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:28 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD Sep 01 01:56:28 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:28 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:28 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD Sep 01 01:56:28 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:28 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] 1f5440bc-a155-4edf-b38b-4a05980bc72e was raw, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:29 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 Sep 01 01:56:29 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:29 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2" returned: 0 in 0.429s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f5440bc-a155-4edf-b38b-4a05980bc72e_j04w7wy3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:56:29 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:29 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 1G Sep 01 01:56:29 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:29 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 1G" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Downloaded image 1f5440bc-a155-4edf-b38b-4a05980bc72e ((None, [{'url': 'file:///opt/stack/data/glance/images/1f5440bc-a155-4edf-b38b-4a05980bc72e', 'metadata': {}}])) to volume cc5cf4f7-1cf1-455c-a23a-93572b773ff2 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Temporary image 1f5440bc-a155-4edf-b38b-4a05980bc72e for user 70bd47309b23426f9d8dec8506d11080 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Marking volume cc5cf4f7-1cf1-455c-a23a-93572b773ff2 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Copying metadata from image 1f5440bc-a155-4edf-b38b-4a05980bc72e to cc5cf4f7-1cf1-455c-a23a-93572b773ff2. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Creating volume glance metadata for volume cc5cf4f7-1cf1-455c-a23a-93572b773ff2 backed by image 1f5440bc-a155-4edf-b38b-4a05980bc72e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1f5440bc-a155-4edf-b38b-4a05980bc72e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd1a181a3001f30e690abfc8b1ef57b67', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c53962-7713-4444-967d-1d4daf8d30c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2', 'volume_size': 1, 'image_id': '1f5440bc-a155-4edf-b38b-4a05980bc72e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f5440bc-a155-4edf-b38b-4a05980bc72e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd1a181a3001f30e690abfc8b1ef57b67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26b59109cc7645798fd2d6737fdb6cd5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd847ecf439f8836fec5c33c30c82601054969241e67c0d926ce84d6e39c5237116f8559bb953c923093531d606ceb34aaa412cb84da84cda85520b71da71c11b', 'id': '1f5440bc-a155-4edf-b38b-4a05980bc72e', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f5440bc-a155-4edf-b38b-4a05980bc72e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81364ea5-e539-415b-870d-7f08d9e89c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Volume volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 (cc5cf4f7-1cf1-455c-a23a-93572b773ff2): created successfully Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81364ea5-e539-415b-870d-7f08d9e89c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Flow 'volume_create_manager' (cd23f79b-a509-4e45-b260-9adbce3ddc03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b3343ac9-0448-41b2-9405-ff4535da7174 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Created volume successfully. Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Acquiring lock "cinder-cc5cf4f7-1cf1-455c-a23a-93572b773ff2-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "cinder-cc5cf4f7-1cf1-455c-a23a-93572b773ff2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Acquiring lock "cinder-quobyte-cc5cf4f7-1cf1-455c-a23a-93572b773ff2" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "cinder-quobyte-cc5cf4f7-1cf1-455c-a23a-93572b773ff2" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e1943a-aa27-4e66-a534-c1b66ae628ba]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:30 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 Sep 01 01:56:30 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:30 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2" returned: 0 in 0.368s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:30 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2 Sep 01 01:56:30 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:31 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-cc5cf4f7-1cf1-455c-a23a-93572b773ff2" returned: 0 in 0.233s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "cinder-quobyte-cc5cf4f7-1cf1-455c-a23a-93572b773ff2" released by "delete_volume" :: held 0.638s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:31 devstack cinder-volume[87212]: WARNING cinder.quota [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:56:31 devstack cinder-volume[87212]: WARNING cinder.quota [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Created reservations ['539e5205-9faf-4432-b408-2ddaeb203298', 'b8de78ec-d4ba-43ce-a749-d0d1c17a24df', 'e26b8cce-a7ea-42b7-bb5e-360386a84ed4', '5c6f4b7d-4ed8-4791-b202-e7adfde5f511'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:31 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:31 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:31 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.276s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Deleted volume successfully. Sep 01 01:56:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f68b847c-11a5-4d1e-8672-fc4b9f6e1c30 tempest-VolumeAndVolumeTypeFromImageTest-1629908610 None] Lock "cinder-cc5cf4f7-1cf1-455c-a23a-93572b773ff2-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (3fdeb7c0-2293-481f-88dd-3e509b6fc993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1dec52-ec39-43b5-ab41-ec79f31d07e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1dec52-ec39-43b5-ab41-ec79f31d07e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598987832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:36Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0722b646-ae7b-4c92-b473-b74edca6fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0722b646-ae7b-4c92-b473-b74edca6fc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c870e926-9d2b-4804-9b3e-63a685cb3ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c870e926-9d2b-4804-9b3e-63a685cb3ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50', 'volume_name': 'volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9da06fb-4b11-4246-a501-b61926b7d83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9da06fb-4b11-4246-a501-b61926b7d83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a645e135-17c6-449f-ae63-5eda6509063a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:35 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50', 'volume_size': 1} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598987832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:36Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Creating volume f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:35 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:35 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 1073741824 Sep 01 01:56:35 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:36 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 1073741824" returned: 0 in 0.444s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:36 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 Sep 01 01:56:36 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:36 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50" returned: 0 in 0.255s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a645e135-17c6-449f-ae63-5eda6509063a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8760b7d-b8a9-45ab-aae3-14efe15c613e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 (f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50): created successfully Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8760b7d-b8a9-45ab-aae3-14efe15c613e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (3fdeb7c0-2293-481f-88dd-3e509b6fc993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f25e2bf6-9e09-4765-9141-135ced998744 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created volume successfully. Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (b49060f7-b2f4-4327-8c54-803131f7d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5c65b3-ee77-4d3f-b036-b0953b3ca965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5c65b3-ee77-4d3f-b036-b0953b3ca965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542441540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a2dac1-b9c9-4e47-b04a-82ef20091537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:37Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475fdc1b-9fd4-447d-93b3-0f29b734b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475fdc1b-9fd4-447d-93b3-0f29b734b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f15a184-09e2-483d-ab29-883f807544cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f15a184-09e2-483d-ab29-883f807544cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a2dac1-b9c9-4e47-b04a-82ef20091537', 'volume_name': 'volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c264f9be-269f-4d32-9b3a-95d91c905695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c264f9be-269f-4d32-9b3a-95d91c905695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77baceb0-89cb-47a9-a641-669ae57916c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume a6a2dac1-b9c9-4e47-b04a-82ef20091537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537', 'volume_size': 1} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542441540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a2dac1-b9c9-4e47-b04a-82ef20091537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:37Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Creating volume a6a2dac1-b9c9-4e47-b04a-82ef20091537 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:37 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:37 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 1073741824 Sep 01 01:56:37 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (b3d74e6a-d18e-4804-bf4d-970184a1adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e96ea1-8414-4051-a862-d4c9f2de071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e96ea1-8414-4051-a862-d4c9f2de071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320448943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b570fb-b8e1-4732-aa82-9e530b5f64da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:38Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a642a96e-9787-4a63-b12b-86f311a85620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a642a96e-9787-4a63-b12b-86f311a85620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c19a596-cb43-4d1e-9691-b0584defd865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c19a596-cb43-4d1e-9691-b0584defd865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b570fb-b8e1-4732-aa82-9e530b5f64da', 'volume_name': 'volume-16b570fb-b8e1-4732-aa82-9e530b5f64da', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3245b1a-a63d-405b-8729-0275a7b14225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3245b1a-a63d-405b-8729-0275a7b14225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba4fd69-0bd5-418e-ae39-63ee6effb974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:37 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume 16b570fb-b8e1-4732-aa82-9e530b5f64da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b570fb-b8e1-4732-aa82-9e530b5f64da', 'volume_size': 1} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:37 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 1073741824" returned: 0 in 0.486s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:37 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 Sep 01 01:56:37 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (d2a9817a-3b4b-4286-bc1c-b6bf168264be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552eff88-2192-407e-9690-44a3f5f0c750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (552eff88-2192-407e-9690-44a3f5f0c750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-110272852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:38Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54edf7aa-e943-418b-a814-f7cb84b048c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54edf7aa-e943-418b-a814-f7cb84b048c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff80675e-6f33-469a-bf4c-6029bf7bc7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff80675e-6f33-469a-bf4c-6029bf7bc7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7', 'volume_name': 'volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8e22e9-fdf1-4cca-b987-cde3feeeae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8e22e9-fdf1-4cca-b987-cde3feeeae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045f82a6-bf32-4046-baf6-2ba7f6c26e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume 446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7', 'volume_size': 1} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:38 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537" returned: 0 in 0.305s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1320448943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b570fb-b8e1-4732-aa82-9e530b5f64da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:38Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Creating volume 16b570fb-b8e1-4732-aa82-9e530b5f64da {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:38 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77baceb0-89cb-47a9-a641-669ae57916c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da 1073741824 Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d0f849-6ddf-4046-908c-44ea64dc064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 (a6a2dac1-b9c9-4e47-b04a-82ef20091537): created successfully Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d0f849-6ddf-4046-908c-44ea64dc064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (b49060f7-b2f4-4327-8c54-803131f7d485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:38 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2bf050d0-47fa-4806-8858-b7a8e7edc729 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created volume successfully. Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (3635139c-7a79-4ff6-a605-9723adce04d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ff99d4-618d-45f3-8283-96e4134e6c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ff99d4-618d-45f3-8283-96e4134e6c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783919930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f18160-4cd6-4122-b630-eef30e7d4b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:38Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f108f045-da64-4d45-8ba2-3ffbc492b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f108f045-da64-4d45-8ba2-3ffbc492b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c002010d-f916-4e67-b52f-426ebf0e4c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c002010d-f916-4e67-b52f-426ebf0e4c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75f18160-4cd6-4122-b630-eef30e7d4b84', 'volume_name': 'volume-75f18160-4cd6-4122-b630-eef30e7d4b84', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e720bbd-e83b-4ca2-9c1a-ad9d31270b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e720bbd-e83b-4ca2-9c1a-ad9d31270b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae5a400-5a14-4479-87ed-fdce206d30bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume 75f18160-4cd6-4122-b630-eef30e7d4b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75f18160-4cd6-4122-b630-eef30e7d4b84', 'volume_size': 1} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:38 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da 1073741824" returned: 0 in 0.534s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:38 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da Sep 01 01:56:38 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (412b1440-6152-4b7f-ae49-57e8a4a19432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a32ffd-e405-4fe2-8e7d-4cc611c276a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a32ffd-e405-4fe2-8e7d-4cc611c276a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597659611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43425820-5f59-4e92-a44f-4750d569b379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:39Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c54554f-b3d9-4a76-9ed7-7b81ff207caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c54554f-b3d9-4a76-9ed7-7b81ff207caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be63b5e8-9894-4a69-a83c-caa2a6402bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be63b5e8-9894-4a69-a83c-caa2a6402bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43425820-5f59-4e92-a44f-4750d569b379', 'volume_name': 'volume-43425820-5f59-4e92-a44f-4750d569b379', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b8b324-11fd-4eb7-8978-e0142d8d5520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b8b324-11fd-4eb7-8978-e0142d8d5520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310c43d0-4b49-488b-a9c6-5936efd06cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume 43425820-5f59-4e92-a44f-4750d569b379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43425820-5f59-4e92-a44f-4750d569b379', 'volume_size': 1} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:39 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da" returned: 0 in 0.275s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-110272852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:38Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Creating volume 446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:39 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba4fd69-0bd5-418e-ae39-63ee6effb974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b570fb-b8e1-4732-aa82-9e530b5f64da', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:39 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 1073741824 Sep 01 01:56:39 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ede8ed-ae6f-46d9-92b7-12396c1ea289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume volume-16b570fb-b8e1-4732-aa82-9e530b5f64da (16b570fb-b8e1-4732-aa82-9e530b5f64da): created successfully Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ede8ed-ae6f-46d9-92b7-12396c1ea289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (b3d74e6a-d18e-4804-bf4d-970184a1adae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b6b457fa-d5fd-45fe-aeaa-88a4672ab753 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created volume successfully. Sep 01 01:56:39 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 1073741824" returned: 0 in 0.425s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:39 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 Sep 01 01:56:39 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:39 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7" returned: 0 in 0.249s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783919930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f18160-4cd6-4122-b630-eef30e7d4b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:38Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Creating volume 75f18160-4cd6-4122-b630-eef30e7d4b84 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:39 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045f82a6-bf32-4046-baf6-2ba7f6c26e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:39 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 1073741824 Sep 01 01:56:39 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3290afcb-1e02-49e0-84fd-919287aea4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 (446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7): created successfully Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3290afcb-1e02-49e0-84fd-919287aea4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (d2a9817a-3b4b-4286-bc1c-b6bf168264be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-86fe5284-f261-49ea-988d-cd2eeeb80f69 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created volume successfully. Sep 01 01:56:40 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 1073741824" returned: 0 in 0.445s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:40 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 Sep 01 01:56:40 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:40 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84" returned: 0 in 0.246s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1597659611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43425820-5f59-4e92-a44f-4750d569b379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6b2f8119b4ceead7558b5da8fa17f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:39Z,use_quota=True,user_id='ebcf3cc061c64e7fbb2b90446773df8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Creating volume 43425820-5f59-4e92-a44f-4750d569b379 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:40 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae5a400-5a14-4479-87ed-fdce206d30bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f18160-4cd6-4122-b630-eef30e7d4b84', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:40 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 1073741824 Sep 01 01:56:40 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f69d18-0fc5-4a3d-8c11-cb0cd0b8584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:40 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume volume-75f18160-4cd6-4122-b630-eef30e7d4b84 (75f18160-4cd6-4122-b630-eef30e7d4b84): created successfully Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f69d18-0fc5-4a3d-8c11-cb0cd0b8584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (3635139c-7a79-4ff6-a605-9723adce04d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:40 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-00a689b4-bbd1-4adf-9e76-d62ffe0d669a tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created volume successfully. Sep 01 01:56:40 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 1073741824" returned: 0 in 0.399s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:40 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 Sep 01 01:56:40 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:41 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310c43d0-4b49-488b-a9c6-5936efd06cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43425820-5f59-4e92-a44f-4750d569b379', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0c2cef-8107-4be0-a1ea-af64c38fe01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:41 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Volume volume-43425820-5f59-4e92-a44f-4750d569b379 (43425820-5f59-4e92-a44f-4750d569b379): created successfully Sep 01 01:56:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0c2cef-8107-4be0-a1ea-af64c38fe01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Flow 'volume_create_manager' (412b1440-6152-4b7f-ae49-57e8a4a19432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-749d18fb-5ee6-4604-ad19-7d504af140ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created volume successfully. Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-43425820-5f59-4e92-a44f-4750d569b379-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-43425820-5f59-4e92-a44f-4750d569b379-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-quobyte-43425820-5f59-4e92-a44f-4750d569b379" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-43425820-5f59-4e92-a44f-4750d569b379" acquired by "delete_volume" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b32b54-dbd6-413e-ba57-e3cb71159cab]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:42 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 Sep 01 01:56:42 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:42 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379" returned: 0 in 0.346s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:42 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379 Sep 01 01:56:42 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:43 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43425820-5f59-4e92-a44f-4750d569b379" returned: 0 in 0.228s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-43425820-5f59-4e92-a44f-4750d569b379" released by "delete_volume" :: held 0.611s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created reservations ['1b2d9da9-8bdb-490c-9b25-a2ed9dffd6d3', 'fbad90c9-6b58-4f98-9cc6-669c8eb9f0e0', 'a24348a0-ac66-4bdb-9fed-94f8a064b3f2', '93f08c81-e3fa-4ca3-b6c3-17b83a9bff36'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:43 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:43 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:43 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.236s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Deleted volume successfully. Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-222b6fe8-21a9-4c57-93f3-f5fed9d7f1ac tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-43425820-5f59-4e92-a44f-4750d569b379-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-75f18160-4cd6-4122-b630-eef30e7d4b84-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-75f18160-4cd6-4122-b630-eef30e7d4b84-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-quobyte-75f18160-4cd6-4122-b630-eef30e7d4b84" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-75f18160-4cd6-4122-b630-eef30e7d4b84" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b476e60a-745a-456f-a273-2d2a49ccf2f7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:43 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 Sep 01 01:56:43 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:43 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84" returned: 0 in 0.365s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:43 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84 Sep 01 01:56:43 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:44 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-75f18160-4cd6-4122-b630-eef30e7d4b84" returned: 0 in 0.248s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-75f18160-4cd6-4122-b630-eef30e7d4b84" released by "delete_volume" :: held 0.647s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created reservations ['84f7e732-38a7-474d-9126-f1bbdf2a9407', '82181aa1-bae0-4d05-9d08-df5a21deaff0', '3715f546-99c1-4001-80b6-d585e3f86494', '5591b232-387a-44df-856c-b10537767991'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:44 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:44 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:44 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Deleted volume successfully. Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c0a782fc-c12f-4608-b2d6-c0f65ab1f261 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-75f18160-4cd6-4122-b630-eef30e7d4b84-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-quobyte-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef499e4-c947-48bd-9499-b0603841ceb7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:44 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 Sep 01 01:56:44 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:45 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7" returned: 0 in 0.335s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:45 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7 Sep 01 01:56:45 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:45 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7" returned: 0 in 0.238s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7" released by "delete_volume" :: held 0.609s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created reservations ['66ff2ee1-9b0d-4e09-b9c1-2aed57f5a1ba', '840b56e4-a2ce-4ce9-94f8-6f4da26cec65', '6a8bd09a-e487-404e-99cc-06a65cf723e1', 'fd56bf02-17ee-40f0-bf61-11e734dbc183'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:45 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:45 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:45 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.244s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Deleted volume successfully. Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-629fab75-3b1e-4dcc-a93c-9c821a87d584 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-446638fa-7fdb-43ed-9b1a-8ec37d9c5aa7-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-16b570fb-b8e1-4732-aa82-9e530b5f64da-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-16b570fb-b8e1-4732-aa82-9e530b5f64da-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-quobyte-16b570fb-b8e1-4732-aa82-9e530b5f64da" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-16b570fb-b8e1-4732-aa82-9e530b5f64da" acquired by "delete_volume" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc13b040-ccc0-4f8f-8be0-24cf98981c3f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:46 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da Sep 01 01:56:46 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:46 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da" returned: 0 in 0.361s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:46 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da Sep 01 01:56:46 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:46 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-16b570fb-b8e1-4732-aa82-9e530b5f64da" returned: 0 in 0.238s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-16b570fb-b8e1-4732-aa82-9e530b5f64da" released by "delete_volume" :: held 0.636s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created reservations ['8c6eab6a-4ac8-4531-9bbe-e9bd0349ca24', '6d16ef42-8c88-41b7-8bb0-0426322e0499', '2fae7bd5-26a1-46af-b749-842db1154968', '6d7818a2-856f-486a-b157-7bec83f14ac3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:46 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:46 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:46 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.232s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:46 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Deleted volume successfully. Sep 01 01:56:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-128be63e-ab13-4175-8ddc-f518320e141e tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-16b570fb-b8e1-4732-aa82-9e530b5f64da-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-a6a2dac1-b9c9-4e47-b04a-82ef20091537-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-a6a2dac1-b9c9-4e47-b04a-82ef20091537-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-quobyte-a6a2dac1-b9c9-4e47-b04a-82ef20091537" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-a6a2dac1-b9c9-4e47-b04a-82ef20091537" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e435055-3c04-43cb-99f7-866d4e4fe6f0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:47 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 Sep 01 01:56:47 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:47 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537" returned: 0 in 0.368s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:47 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537 Sep 01 01:56:47 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:47 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6a2dac1-b9c9-4e47-b04a-82ef20091537" returned: 0 in 0.263s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-a6a2dac1-b9c9-4e47-b04a-82ef20091537" released by "delete_volume" :: held 0.670s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created reservations ['6af660b7-020c-49ca-afb4-b4b84358abb2', '793ae575-d5ec-4c85-94b9-85009f078c36', '2d9d903e-2fd7-4add-a438-cd26db9c763e', '878df662-e764-4f51-96d6-73c9aef2a34f'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:47 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:47 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:48 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.258s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Deleted volume successfully. Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-fe8528d9-a164-418c-ad8c-025b97594b96 tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-a6a2dac1-b9c9-4e47-b04a-82ef20091537-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "cinder-quobyte-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cacc07b-b90b-4073-93b4-3fa073d5e98f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:48 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 Sep 01 01:56:48 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:48 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50" returned: 0 in 0.384s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:48 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50 Sep 01 01:56:48 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:48 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50" returned: 0 in 0.244s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-quobyte-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50" released by "delete_volume" :: held 0.665s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:48 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Created reservations ['aff4196a-763c-452b-a593-4da8be741aca', '3a37b036-8d26-4040-ab76-f6ec85427a24', '704eeb30-e96f-4aff-af28-f37399cee328', 'ceba019f-7f36-4f00-ada1-9a34f28307fe'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:49 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:56:49 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:49 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.242s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Deleted volume successfully. Sep 01 01:56:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3353207d-a7e0-4645-a052-acb675176e8d tempest-CreateVolumesFromSourceVolumeTest-486458759 None] Lock "cinder-f9b2c1af-06d1-4cb9-ae1c-605ef3bd2c50-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Flow 'volume_create_manager' (60e38f64-e606-479d-bc0b-aa45ee316c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806eeed3-b667-4464-91eb-4292e74a8af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806eeed3-b667-4464-91eb-4292e74a8af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51932b55-03bf-408b-bbfe-0c9ad18864b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6d5e9cf69040b8a182facb49ca17f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:54Z,use_quota=True,user_id='c395e68c8dc944a486a7af02bfa258ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e264c4-bf23-4938-b5dc-3bad902128f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e264c4-bf23-4938-b5dc-3bad902128f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c05347-01e7-412d-b966-33962be3cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c05347-01e7-412d-b966-33962be3cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51932b55-03bf-408b-bbfe-0c9ad18864b8', 'volume_name': 'volume-51932b55-03bf-408b-bbfe-0c9ad18864b8', 'volume_size': 1, 'image_id': '8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed68995eea22dcd0a4a9ae89f4b1b87e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df6d5e9cf69040b8a182facb49ca17f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea9c2efe51fb621178c65fb67d48d73912b6dde1d76556ace75ce338c06fcbca84be79e81f0157b658971808eb1bda7d2dbe5168fb60a4ed96fe4e66f010de24', 'id': '8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b/file', 'properties': {}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92f89e9-4ecf-45c4-a20e-c3f2ca57e83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92f89e9-4ecf-45c4-a20e-c3f2ca57e83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d1cb90-df17-4320-9940-29de61a838da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:54 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Volume 51932b55-03bf-408b-bbfe-0c9ad18864b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51932b55-03bf-408b-bbfe-0c9ad18864b8', 'volume_size': 1, 'image_id': '8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed68995eea22dcd0a4a9ae89f4b1b87e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df6d5e9cf69040b8a182facb49ca17f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea9c2efe51fb621178c65fb67d48d73912b6dde1d76556ace75ce338c06fcbca84be79e81f0157b658971808eb1bda7d2dbe5168fb60a4ed96fe4e66f010de24', 'id': '8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b/file', 'properties': {}}, 'image_service': } Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Trying to clone 51932b55-03bf-408b-bbfe-0c9ad18864b8 from image 8d91a79b-f12f-4779-a4b0-8da589e9ba6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:56:54 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebc63f6-58eb-47a2-97b1-fbeeedd9bd04]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:55 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD Sep 01 01:56:55 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:55 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:55 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD Sep 01 01:56:55 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:55 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:55 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Temporary image 8d91a79b-f12f-4779-a4b0-8da589e9ba6b is fetched for user c395e68c8dc944a486a7af02bfa258ff. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:56:55 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d53f22f-18ee-4ef2-9a23-2a7731b81b70]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:55 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD Sep 01 01:56:55 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:56 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:56 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD Sep 01 01:56:56 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:56 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51932b55-03bf-408b-bbfe-0c9ad18864b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df6d5e9cf69040b8a182facb49ca17f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:56:54Z,use_quota=True,user_id='c395e68c8dc944a486a7af02bfa258ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Creating volume 51932b55-03bf-408b-bbfe-0c9ad18864b8 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:56:56 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:56 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 1073741824 Sep 01 01:56:56 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:56 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 1073741824" returned: 0 in 0.403s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:56 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 Sep 01 01:56:56 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:57 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8" returned: 0 in 0.254s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Attempting download of 8d91a79b-f12f-4779-a4b0-8da589e9ba6b ((None, [{'url': 'file:///opt/stack/data/glance/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'metadata': {}}])) to volume 51932b55-03bf-408b-bbfe-0c9ad18864b8. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61ed81b-f4bf-44a8-b0db-2e50b21e7872]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_qxk7b0e9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:57 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_qxk7b0e9 Sep 01 01:56:57 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:57 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_qxk7b0e9" returned: 0 in 0.308s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_qxk7b0e9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:57 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_qxk7b0e9 Sep 01 01:56:57 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:57 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_qxk7b0e9" returned: 1 in 0.319s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_qxk7b0e9' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f141cc9a-c412-4dd8-a6b4-fccd7c6efa86]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:57 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD Sep 01 01:56:57 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:58 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:58 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD Sep 01 01:56:58 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:58 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] 8d91a79b-f12f-4779-a4b0-8da589e9ba6b was raw, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:58 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 Sep 01 01:56:58 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:58 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8" returned: 0 in 0.435s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d91a79b-f12f-4779-a4b0-8da589e9ba6b_865ucknmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:56:58 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:56:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:58 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 1G Sep 01 01:56:58 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:59 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 1G" returned: 0 in 0.362s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Downloaded image 8d91a79b-f12f-4779-a4b0-8da589e9ba6b ((None, [{'url': 'file:///opt/stack/data/glance/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'metadata': {}}])) to volume 51932b55-03bf-408b-bbfe-0c9ad18864b8 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Temporary image 8d91a79b-f12f-4779-a4b0-8da589e9ba6b for user c395e68c8dc944a486a7af02bfa258ff is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Marking volume 51932b55-03bf-408b-bbfe-0c9ad18864b8 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Copying metadata from image 8d91a79b-f12f-4779-a4b0-8da589e9ba6b to 51932b55-03bf-408b-bbfe-0c9ad18864b8. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Creating volume glance metadata for volume 51932b55-03bf-408b-bbfe-0c9ad18864b8 backed by image 8d91a79b-f12f-4779-a4b0-8da589e9ba6b with: {'image_id': '8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ed68995eea22dcd0a4a9ae89f4b1b87e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d1cb90-df17-4320-9940-29de61a838da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51932b55-03bf-408b-bbfe-0c9ad18864b8', 'volume_size': 1, 'image_id': '8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ed68995eea22dcd0a4a9ae89f4b1b87e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df6d5e9cf69040b8a182facb49ca17f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ea9c2efe51fb621178c65fb67d48d73912b6dde1d76556ace75ce338c06fcbca84be79e81f0157b658971808eb1bda7d2dbe5168fb60a4ed96fe4e66f010de24', 'id': '8d91a79b-f12f-4779-a4b0-8da589e9ba6b', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d91a79b-f12f-4779-a4b0-8da589e9ba6b/file', 'properties': {}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d027e7-191a-4631-beda-a14d4ec56f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:56:59 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Volume volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 (51932b55-03bf-408b-bbfe-0c9ad18864b8): created successfully Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d027e7-191a-4631-beda-a14d4ec56f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Flow 'volume_create_manager' (60e38f64-e606-479d-bc0b-aa45ee316c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:56:59 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-faa484cb-e9ec-458e-b34b-c8b8040f1c87 tempest-VolumeImageDependencyTests-2972824 None] Created volume successfully. Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Acquiring lock "cinder-51932b55-03bf-408b-bbfe-0c9ad18864b8-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Lock "cinder-51932b55-03bf-408b-bbfe-0c9ad18864b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Acquiring lock "cinder-quobyte-51932b55-03bf-408b-bbfe-0c9ad18864b8" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Lock "cinder-quobyte-51932b55-03bf-408b-bbfe-0c9ad18864b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5758157a-c479-43d3-ae91-2c2fc650ad5f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:56:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:00 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 Sep 01 01:57:00 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:00 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8" returned: 0 in 0.426s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:00 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8 Sep 01 01:57:00 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:00 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-51932b55-03bf-408b-bbfe-0c9ad18864b8" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Lock "cinder-quobyte-51932b55-03bf-408b-bbfe-0c9ad18864b8" released by "delete_volume" :: held 0.766s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Created reservations ['9c89c7ca-7643-4e01-969a-4f1d3179bc1e', 'f995f5bd-86ab-4980-a16e-ea8f72269754', 'd4627ff5-ee5f-4f49-b802-74e9ce4c92e6', '90006947-3a9a-4202-85b0-438f27760aeb'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:00 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:00 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:01 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.292s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:01 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Deleted volume successfully. Sep 01 01:57:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-723ff2dc-5e9d-464b-90cf-16f9b208cee0 tempest-VolumeImageDependencyTests-2972824 None] Lock "cinder-51932b55-03bf-408b-bbfe-0c9ad18864b8-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Flow 'volume_create_manager' (5a6b3469-e928-47c0-9fc6-1843844d5a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491022ee-69f9-489f-836f-6fac81819955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491022ee-69f9-489f-836f-6fac81819955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a1954a-d53c-49e5-94e2-4d5b9aa774ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c566c513f7148d08aea8e8336cebe11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:04Z,use_quota=True,user_id='cf17cfe9333b4063a88acc8c1eaf9b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d580e0ab-e2de-4683-b23e-7148fa62f8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d580e0ab-e2de-4683-b23e-7148fa62f8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f98fee8-8f76-4d2c-9ec1-c8f5ccf68948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f98fee8-8f76-4d2c-9ec1-c8f5ccf68948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a1954a-d53c-49e5-94e2-4d5b9aa774ce', 'volume_name': 'volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33aad0d6-3630-49b9-acdc-5310b4f528ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33aad0d6-3630-49b9-acdc-5310b4f528ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27600fe9-8e65-41a8-9aae-fb18eeebd833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Volume e7a1954a-d53c-49e5-94e2-4d5b9aa774ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce', 'volume_size': 1} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a1954a-d53c-49e5-94e2-4d5b9aa774ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c566c513f7148d08aea8e8336cebe11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:04Z,use_quota=True,user_id='cf17cfe9333b4063a88acc8c1eaf9b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Creating volume e7a1954a-d53c-49e5-94e2-4d5b9aa774ce {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:04 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:04 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce 1073741824 Sep 01 01:57:04 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:04 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce 1073741824" returned: 0 in 0.461s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:04 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce Sep 01 01:57:04 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:05 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce" returned: 0 in 0.279s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27600fe9-8e65-41a8-9aae-fb18eeebd833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530130b2-c32b-44f3-ae76-e847e74e92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:05 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Volume volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce (e7a1954a-d53c-49e5-94e2-4d5b9aa774ce): created successfully Sep 01 01:57:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530130b2-c32b-44f3-ae76-e847e74e92de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Flow 'volume_create_manager' (5a6b3469-e928-47c0-9fc6-1843844d5a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-effe6289-f3e5-4ae7-8541-385891e4e679 tempest-CinderUnicodeTest-2137406901 None] Created volume successfully. Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Flow 'volume_create_manager' (41cb5b63-e5f5-456d-a31d-91742f8606f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c37bca9-f0ce-481f-9028-b461225c8331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c37bca9-f0ce-481f-9028-b461225c8331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1921607244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8541f05-6b5a-44ca-beb3-ed290b8a3b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c566c513f7148d08aea8e8336cebe11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:07Z,use_quota=True,user_id='cf17cfe9333b4063a88acc8c1eaf9b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3beaae5-119d-4a05-a72b-d4d324179e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3beaae5-119d-4a05-a72b-d4d324179e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b5a8b3-a28c-44ec-b198-89719631a27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b5a8b3-a28c-44ec-b198-89719631a27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8541f05-6b5a-44ca-beb3-ed290b8a3b3b', 'volume_name': 'volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61d4d3f-1bd6-4da5-ad6f-d13f63fb840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61d4d3f-1bd6-4da5-ad6f-d13f63fb840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac531066-fd67-4552-bce0-417f623b0ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:06 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Volume c8541f05-6b5a-44ca-beb3-ed290b8a3b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b', 'volume_size': 1} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1921607244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8541f05-6b5a-44ca-beb3-ed290b8a3b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c566c513f7148d08aea8e8336cebe11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:07Z,use_quota=True,user_id='cf17cfe9333b4063a88acc8c1eaf9b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Creating volume c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:07 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:07 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b 1073741824 Sep 01 01:57:07 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:07 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b 1073741824" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:07 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b Sep 01 01:57:07 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:07 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac531066-fd67-4552-bce0-417f623b0ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d990820-9f3a-4100-a9f7-8f0fa2615a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:07 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Volume volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b (c8541f05-6b5a-44ca-beb3-ed290b8a3b3b): created successfully Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d990820-9f3a-4100-a9f7-8f0fa2615a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Flow 'volume_create_manager' (41cb5b63-e5f5-456d-a31d-91742f8606f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3e24df24-50ad-4636-bc00-30d514eb2157 tempest-CinderUnicodeTest-2137406901 None] Created volume successfully. Sep 01 01:57:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Creating offline snapshot 8efd1362-e88e-468c-b186-93e630cfe330 of volume c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:57:08 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[be99056c-a7f6-4009-9888-7f2845028624]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:08 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b Sep 01 01:57:08 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:08 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:08 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 1G Sep 01 01:57:08 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:09 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 1G" returned: 0 in 0.407s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:09 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 Sep 01 01:57:09 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:09 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330" returned: 0 in 0.273s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:09 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 is being set with open permissions: ugo+rw Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:09 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 Sep 01 01:57:09 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:09 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:09 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.info Sep 01 01:57:09 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:09 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.info" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:09 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.info is being set with open permissions: ugo+rw Sep 01 01:57:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:09 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.info Sep 01 01:57:09 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:10 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.info" returned: 0 in 0.231s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0ccbe889-0a84-4678-be54-29fc40cfcf4b tempest-CinderUnicodeTest-2137406901 None] Create snapshot completed successfully Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "cinder-8efd1362-e88e-468c-b186-93e630cfe330-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-8efd1362-e88e-468c-b186-93e630cfe330-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "cinder-quobyte-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "cinder-quobyte-8efd1362-e88e-468c-b186-93e630cfe330" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-8efd1362-e88e-468c-b186-93e630cfe330" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Deleting offline snapshot 8efd1362-e88e-468c-b186-93e630cfe330 of volume c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] snapshot_file for this snap is: volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[74643459-57cd-4e59-91d2-02fc38516f63]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:10 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 Sep 01 01:57:10 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:10 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330" returned: 0 in 0.388s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[57985feb-3376-42da-b843-bccc636375e2]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:10 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b Sep 01 01:57:10 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:11 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" returned: 0 in 0.358s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:11 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 Sep 01 01:57:11 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:11 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330" returned: 0 in 0.331s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:11 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330 Sep 01 01:57:11 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:11 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b.8efd1362-e88e-468c-b186-93e630cfe330" returned: 0 in 0.228s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-8efd1362-e88e-468c-b186-93e630cfe330" released by "_delete_snapshot" :: held 1.400s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" released by "delete_snapshot" :: held 1.423s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Created reservations ['b3f2db71-5cb6-4a0b-8461-7fcad948decc', 'e1ee7e78-c1b5-47d5-8d16-81106365095d', '404553f5-a678-48cf-b7a1-26ec521b49d6', 'ddc1b7ca-dc3f-4b88-a0ec-d16a06cc6dd2'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Delete snapshot completed successfully. Sep 01 01:57:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a6483403-5423-4675-aeb8-8a7530a00b94 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-8efd1362-e88e-468c-b186-93e630cfe330-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "cinder-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "cinder-quobyte-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc4d92-3094-4ec4-8036-584981ed9885]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:12 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b Sep 01 01:57:12 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:12 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" returned: 0 in 0.358s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:12 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b Sep 01 01:57:12 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:13 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" returned: 0 in 0.244s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b" released by "delete_volume" :: held 0.660s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Created reservations ['80cfb998-b09c-403c-88f0-b3449e1eb0aa', 'f5f39202-ea26-46e3-bb2b-b032725b7aca', 'e7a93fdd-1a95-4f9c-8048-e9d64f463495', 'c373f7b7-3615-4815-bc43-dee099097992'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:13 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:13 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:13 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.245s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:13 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Deleted volume successfully. Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2229c0e-e9dc-4692-9c05-3b9e46d3f30d tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-c8541f05-6b5a-44ca-beb3-ed290b8a3b3b-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "cinder-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "cinder-quobyte-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce" acquired by "delete_volume" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f7f654-9d21-466e-a14b-cdeeebce2646]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:13 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce Sep 01 01:57:13 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:14 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:14 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce Sep 01 01:57:14 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:14 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce" returned: 0 in 0.238s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-quobyte-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce" released by "delete_volume" :: held 0.615s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Created reservations ['16de28a2-848a-4f35-bb67-13e79e3f5273', '3e2dce57-7569-4b82-abb4-a6416e0d669d', 'bcf2c788-56ea-4d23-94cc-c39629472a7b', 'f2406103-db75-4a8c-b981-efc2ae98ad20'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:14 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:14 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:14 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.234s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Deleted volume successfully. Sep 01 01:57:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7c7e035e-76d5-4fa3-a326-b4700d0359f0 tempest-CinderUnicodeTest-2137406901 None] Lock "cinder-e7a1954a-d53c-49e5-94e2-4d5b9aa774ce-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:17 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:17 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:17 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.244s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:57:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:57:24 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=96,cinder:UPDATE=126,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:24 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=115,cinder:SELECT=86,cinder:INSERT=38,cinder:DELETE=11 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:26 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (fff35d5c-cc32-42ba-8d64-e653bef00e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:26 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32c5983-28a8-4893-9cb9-515e96ccf37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32c5983-28a8-4893-9cb9-515e96ccf37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-880903138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a1ad65-9106-499b-a5fa-f75c5395a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:27Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4220845c-cb6e-4ec6-a34d-4eb055f093a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4220845c-cb6e-4ec6-a34d-4eb055f093a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c772458c-d031-4653-ab8b-6e2ab62d8de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c772458c-d031-4653-ab8b-6e2ab62d8de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a1ad65-9106-499b-a5fa-f75c5395a111', 'volume_name': 'volume-56a1ad65-9106-499b-a5fa-f75c5395a111', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4eec6d-159e-4673-96c7-e7f3db0156b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4eec6d-159e-4673-96c7-e7f3db0156b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e917545-296d-44f3-b1dd-e40f9bdcf48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Volume 56a1ad65-9106-499b-a5fa-f75c5395a111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a1ad65-9106-499b-a5fa-f75c5395a111', 'volume_size': 1} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-880903138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a1ad65-9106-499b-a5fa-f75c5395a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:27Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Creating volume 56a1ad65-9106-499b-a5fa-f75c5395a111 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:27 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:27 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 1073741824 Sep 01 01:57:27 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (e0ad0e7f-111c-469b-87bc-4e5c9bdcebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cd49d9-478a-47b5-b9e0-963626554144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cd49d9-478a-47b5-b9e0-963626554144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674707087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276704a1-ec54-4d3e-8404-977ed517b91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:27Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4b8dfc-8995-446d-9ac8-11b32d888af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4b8dfc-8995-446d-9ac8-11b32d888af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d080c20-51ec-4f69-a6d8-e9b11164bb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d080c20-51ec-4f69-a6d8-e9b11164bb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276704a1-ec54-4d3e-8404-977ed517b91e', 'volume_name': 'volume-276704a1-ec54-4d3e-8404-977ed517b91e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7630a49-13fc-4e1d-b3ca-2b758f665711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7630a49-13fc-4e1d-b3ca-2b758f665711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b190167-0069-4fed-a17b-a73932b39988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume 276704a1-ec54-4d3e-8404-977ed517b91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276704a1-ec54-4d3e-8404-977ed517b91e', 'volume_size': 1} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (fe1d6c0e-b701-4618-869c-83c1197d976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4c40a3-39db-4deb-8a4c-326aeecac5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4c40a3-39db-4deb-8a4c-326aeecac5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705160008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef8edcb-25a5-416a-8da1-093649a55bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:28Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8952f55e-dab9-42f5-97e1-ac341cd38d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8952f55e-dab9-42f5-97e1-ac341cd38d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c581caec-92d6-4c21-b722-6ae12c28bbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c581caec-92d6-4c21-b722-6ae12c28bbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef8edcb-25a5-416a-8da1-093649a55bf4', 'volume_name': 'volume-1ef8edcb-25a5-416a-8da1-093649a55bf4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730db786-7647-4a71-b2b9-8d39cfc30fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730db786-7647-4a71-b2b9-8d39cfc30fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3c6df3-31a4-4576-b182-bca4f4bd420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:27 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Volume 1ef8edcb-25a5-416a-8da1-093649a55bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef8edcb-25a5-416a-8da1-093649a55bf4', 'volume_size': 1} Sep 01 01:57:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:28 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 1073741824" returned: 0 in 0.887s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:28 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 Sep 01 01:57:28 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (8cc398d0-2e73-4644-9fe2-4bac4bd05e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9f67ae-2240-42e2-99f3-790dffd2f2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9f67ae-2240-42e2-99f3-790dffd2f2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922135109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1e7029-f646-4cb6-ad41-a21d04b05efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:28Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a361ff64-c959-43ae-9328-da90554e51db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a361ff64-c959-43ae-9328-da90554e51db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512a7108-bbf0-4283-9402-cb3649f12968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512a7108-bbf0-4283-9402-cb3649f12968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1e7029-f646-4cb6-ad41-a21d04b05efc', 'volume_name': 'volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8c4cc6-20e8-49f0-b1da-cc8e1d0b0c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8c4cc6-20e8-49f0-b1da-cc8e1d0b0c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f179e9a2-9a95-4640-bb9a-2e67cd9f0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Volume ac1e7029-f646-4cb6-ad41-a21d04b05efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc', 'volume_size': 1} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:28 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111" returned: 0 in 0.424s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674707087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276704a1-ec54-4d3e-8404-977ed517b91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:27Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Creating volume 276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:28 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e917545-296d-44f3-b1dd-e40f9bdcf48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a1ad65-9106-499b-a5fa-f75c5395a111', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5fc9bf-4586-4092-907d-c203a5fedd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e 1073741824 Sep 01 01:57:28 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Volume volume-56a1ad65-9106-499b-a5fa-f75c5395a111 (56a1ad65-9106-499b-a5fa-f75c5395a111): created successfully Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5fc9bf-4586-4092-907d-c203a5fedd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (fff35d5c-cc32-42ba-8d64-e653bef00e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:28 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-fb4fc58d-67ad-4218-b3ec-d66637f84140 tempest-CreateVolumesFromImageTest-2054535062 None] Created volume successfully. Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (8310f866-9bd8-4985-b02a-485f884c1695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9550e8fb-1ba7-4e1d-94c3-59d8038c889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9550e8fb-1ba7-4e1d-94c3-59d8038c889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1666924500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4420bba3-48db-4202-9bab-6468f164a4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:29Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23be4b6-d277-483a-befd-af5f3df867d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23be4b6-d277-483a-befd-af5f3df867d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38fa05-49d5-4b81-adda-6b6b22c00b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad38fa05-49d5-4b81-adda-6b6b22c00b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4420bba3-48db-4202-9bab-6468f164a4ed', 'volume_name': 'volume-4420bba3-48db-4202-9bab-6468f164a4ed', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa3b3a6-2008-4ec1-b03a-3ef0eb6847c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aa3b3a6-2008-4ec1-b03a-3ef0eb6847c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927c90ac-df90-4dd1-b0dc-3c086b10d71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Volume 4420bba3-48db-4202-9bab-6468f164a4ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4420bba3-48db-4202-9bab-6468f164a4ed', 'volume_size': 1} Sep 01 01:57:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:29 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (a7fe739c-65ce-487e-8d75-1e4ba5f29c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e68370-a5d0-4e17-9c6c-8340722c39e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e 1073741824" returned: 0 in 0.759s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e68370-a5d0-4e17-9c6c-8340722c39e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76589023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b7d6b6-870a-41ed-beb1-49aff102d8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:29Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad36cea-8105-4dd8-a4c2-93c8dfc80365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad36cea-8105-4dd8-a4c2-93c8dfc80365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69b9ee6-9fea-46b0-b7fd-69361fcd0973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69b9ee6-9fea-46b0-b7fd-69361fcd0973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b7d6b6-870a-41ed-beb1-49aff102d8e2', 'volume_name': 'volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc2dbe-12b0-4bfc-baac-4ca1889bbc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc2dbe-12b0-4bfc-baac-4ca1889bbc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d740f8-8421-42c5-923a-a8dda756649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Volume 80b7d6b6-870a-41ed-beb1-49aff102d8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2', 'volume_size': 1} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:29 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e Sep 01 01:57:29 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:29 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e" returned: 0 in 0.290s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705160008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef8edcb-25a5-416a-8da1-093649a55bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:28Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Creating volume 1ef8edcb-25a5-416a-8da1-093649a55bf4 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:29 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:29 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 1073741824 Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b190167-0069-4fed-a17b-a73932b39988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276704a1-ec54-4d3e-8404-977ed517b91e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:29 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e39cb95-a230-4d7c-9690-50505124b853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume volume-276704a1-ec54-4d3e-8404-977ed517b91e (276704a1-ec54-4d3e-8404-977ed517b91e): created successfully Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e39cb95-a230-4d7c-9690-50505124b853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (e0ad0e7f-111c-469b-87bc-4e5c9bdcebc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e8d3a423-4614-4e14-a193-866d719456f9 tempest-CreateVolumesFromSnapshotTest-874910766 None] Created volume successfully. Sep 01 01:57:30 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 1073741824" returned: 0 in 0.592s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:30 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 Sep 01 01:57:30 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:30 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4" returned: 0 in 0.383s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922135109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1e7029-f646-4cb6-ad41-a21d04b05efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:28Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Creating volume ac1e7029-f646-4cb6-ad41-a21d04b05efc {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:30 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:30 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc 1073741824 Sep 01 01:57:30 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa3c6df3-31a4-4576-b182-bca4f4bd420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef8edcb-25a5-416a-8da1-093649a55bf4', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeed9f96-32e2-40da-a41f-aecebc79ae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:30 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Volume volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 (1ef8edcb-25a5-416a-8da1-093649a55bf4): created successfully Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeed9f96-32e2-40da-a41f-aecebc79ae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (fe1d6c0e-b701-4618-869c-83c1197d976a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:30 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-eaa7f66e-dfed-4ddd-b49b-53eb13c3e2fe tempest-CreateVolumesFromImageTest-2054535062 None] Created volume successfully. Sep 01 01:57:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:31 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc 1073741824" returned: 0 in 0.638s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:31 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc Sep 01 01:57:31 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:31 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc" returned: 0 in 0.341s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.834s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1666924500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4420bba3-48db-4202-9bab-6468f164a4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:29Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Creating volume 4420bba3-48db-4202-9bab-6468f164a4ed {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:31 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f179e9a2-9a95-4640-bb9a-2e67cd9f0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:31 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed 1073741824 Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64d4662-fc9d-411a-abd4-e9a3cd353db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:31 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:31 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Volume volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc (ac1e7029-f646-4cb6-ad41-a21d04b05efc): created successfully Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64d4662-fc9d-411a-abd4-e9a3cd353db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (8cc398d0-2e73-4644-9fe2-4bac4bd05e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b54cae09-6e07-40ae-afa6-ee876f2f5ce5 tempest-CreateVolumesFromImageTest-2054535062 None] Created volume successfully. Sep 01 01:57:32 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed 1073741824" returned: 0 in 0.678s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Flow 'volume_create_manager' (67f09c35-6471-49da-ad14-dddcd9e6043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029a0b1f-7d89-4c36-a526-097d83c3c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029a0b1f-7d89-4c36-a526-097d83c3c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc16e731-6ce3-4999-adbc-9f8a4e7325a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc6d44e09034355b3837f010397b37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:32Z,use_quota=True,user_id='6aa18bb26d4e44fea69d0f3851f34251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3af3932a-765a-45df-9ccc-aaeb7e1b1586),volume_type_id=3af3932a-765a-45df-9ccc-aaeb7e1b1586)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:32 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee93879-9854-4856-896f-52d75866822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:32 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee93879-9854-4856-896f-52d75866822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66c7054-60d5-4108-b60f-6eee4468d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:57:32 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.532s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76589023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b7d6b6-870a-41ed-beb1-49aff102d8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe2d7881c2644e4add295b1eb708117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:29Z,use_quota=True,user_id='d8cff59247ec4538bc3d81e37f66d6ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Creating volume 80b7d6b6-870a-41ed-beb1-49aff102d8e2 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:32 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927c90ac-df90-4dd1-b0dc-3c086b10d71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4420bba3-48db-4202-9bab-6468f164a4ed', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d209f1ac-2f1b-4996-94e5-6e99b8835faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:32 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 1073741824 Sep 01 01:57:32 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Volume volume-4420bba3-48db-4202-9bab-6468f164a4ed (4420bba3-48db-4202-9bab-6468f164a4ed): created successfully Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d209f1ac-2f1b-4996-94e5-6e99b8835faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (8310f866-9bd8-4985-b02a-485f884c1695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-94db16b3-71e1-48b8-ac49-cde992846a26 tempest-CreateVolumesFromImageTest-2054535062 None] Created volume successfully. Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66c7054-60d5-4108-b60f-6eee4468d962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc16e731-6ce3-4999-adbc-9f8a4e7325a3', 'volume_name': 'volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3', 'volume_size': 1, 'image_id': 'ba83f621-507b-4faa-8b5c-97243bd67c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba83f621-507b-4faa-8b5c-97243bd67c21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f23ec40dd113d965c535ac1b1ddb1de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdc6d44e09034355b3837f010397b37a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89e6f7a179a1f56e79ef64ebe6b7dfce8e7601dbca23a50cbd43e9811e82a2579c2534b1fa43e91bfafa21d79f6880f81ea86ad667492a720a89183b10d46e3a', 'id': 'ba83f621-507b-4faa-8b5c-97243bd67c21', 'created_at': datetime.datetime(2026, 8, 31, 23, 57, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 57, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba83f621-507b-4faa-8b5c-97243bd67c21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3b7e67-4979-442c-a9be-878531bb1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3b7e67-4979-442c-a9be-878531bb1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d17de5-faed-4031-b12d-2685a13860b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:33 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Volume bc16e731-6ce3-4999-adbc-9f8a4e7325a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3', 'volume_size': 1, 'image_id': 'ba83f621-507b-4faa-8b5c-97243bd67c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba83f621-507b-4faa-8b5c-97243bd67c21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f23ec40dd113d965c535ac1b1ddb1de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdc6d44e09034355b3837f010397b37a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89e6f7a179a1f56e79ef64ebe6b7dfce8e7601dbca23a50cbd43e9811e82a2579c2534b1fa43e91bfafa21d79f6880f81ea86ad667492a720a89183b10d46e3a', 'id': 'ba83f621-507b-4faa-8b5c-97243bd67c21', 'created_at': datetime.datetime(2026, 8, 31, 23, 57, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 57, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba83f621-507b-4faa-8b5c-97243bd67c21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Trying to clone bc16e731-6ce3-4999-adbc-9f8a4e7325a3 from image ba83f621-507b-4faa-8b5c-97243bd67c21 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba83f621-507b-4faa-8b5c-97243bd67c21', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:57:33 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b19d4c-7be6-46d0-87cf-37dcd492e23a]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:33 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 1073741824" returned: 0 in 0.520s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:33 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD Sep 01 01:57:33 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:33 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 Sep 01 01:57:33 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:33 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:33 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2" returned: 0 in 0.294s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.830s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Creating offline snapshot 80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d of volume 276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d740f8-8421-42c5-923a-a8dda756649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739a682f-2085-4a54-9482-60672b903299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6acee6-a0ae-4b48-91b9-422703cf745a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:33 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Volume volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 (80b7d6b6-870a-41ed-beb1-49aff102d8e2): created successfully Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739a682f-2085-4a54-9482-60672b903299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Flow 'volume_create_manager' (a7fe739c-65ce-487e-8d75-1e4ba5f29c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b7a5f16b-8739-43c7-8f81-6e2e5e030945 tempest-CreateVolumesFromImageTest-2054535062 None] Created volume successfully. Sep 01 01:57:33 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD Sep 01 01:57:33 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:33 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e Sep 01 01:57:33 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:34 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Temporary image ba83f621-507b-4faa-8b5c-97243bd67c21 is fetched for user 6aa18bb26d4e44fea69d0f3851f34251. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[807afce6-a963-4fa4-a3fe-0ab00ca9b1af]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:34 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e" returned: 0 in 0.397s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:34 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d 1G Sep 01 01:57:34 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:34 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD Sep 01 01:57:34 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:34 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:34 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD Sep 01 01:57:34 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:34 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d 1G" returned: 0 in 0.537s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276704a1-ec54-4d3e-8404-977ed517b91e -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:34 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276704a1-ec54-4d3e-8404-977ed517b91e -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d Sep 01 01:57:34 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (ea3f5c5f-b175-443d-848b-8fccf35f51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde88e66-96f1-4b5a-a1cf-2c3425e18744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde88e66-96f1-4b5a-a1cf-2c3425e18744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241231010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cab189-5d1f-484c-9c9e-d81e1db2f254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:35Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63881f02-e1f3-4283-b289-43c604cc2ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63881f02-e1f3-4283-b289-43c604cc2ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52599050-ce64-45a2-98ff-dedd3492e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52599050-ce64-45a2-98ff-dedd3492e01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43cab189-5d1f-484c-9c9e-d81e1db2f254', 'volume_name': 'volume-43cab189-5d1f-484c-9c9e-d81e1db2f254', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a6d185-f62a-4247-895a-5e12507dddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a6d185-f62a-4247-895a-5e12507dddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91382078-acbf-4899-af1d-f81c9dfbf733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:34 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Volume 43cab189-5d1f-484c-9c9e-d81e1db2f254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43cab189-5d1f-484c-9c9e-d81e1db2f254', 'volume_size': 1} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-80b7d6b6-870a-41ed-beb1-49aff102d8e2-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:34 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD" returned: 1 in 0.427s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-80b7d6b6-870a-41ed-beb1-49aff102d8e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-quobyte-80b7d6b6-870a-41ed-beb1-49aff102d8e2" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-80b7d6b6-870a-41ed-beb1-49aff102d8e2" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e295245-bdd4-49cb-ba35-09a47b190262]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276704a1-ec54-4d3e-8404-977ed517b91e -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" returned: 0 in 0.350s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:35 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d is being set with open permissions: ugo+rw Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d Sep 01 01:57:35 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:35 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 Sep 01 01:57:35 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:35 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" returned: 0 in 0.301s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.info Sep 01 01:57:35 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:35 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2 Sep 01 01:57:35 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:35 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.info" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:35 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.info is being set with open permissions: ugo+rw Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-80b7d6b6-870a-41ed-beb1-49aff102d8e2" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:35 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.info Sep 01 01:57:35 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-80b7d6b6-870a-41ed-beb1-49aff102d8e2" released by "delete_volume" :: held 0.717s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Created reservations ['6816fc29-e9ca-4135-a3bf-cd3f04b0c43a', 'e9671090-da6f-4039-a787-2fbd5846bdd1', '564082d5-5fd9-44a5-9a60-eafe4f6acf33', '5d723729-a21e-4ddb-9e2d-b8be4bf2b0f9'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:35 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.info" returned: 0 in 0.279s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241231010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cab189-5d1f-484c-9c9e-d81e1db2f254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:35Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Creating volume 43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:36 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:36 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 1073741824 Sep 01 01:57:36 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5513e029-3faa-40c9-bf05-765ddd321f6a tempest-CreateVolumesFromSnapshotTest-874910766 None] Create snapshot completed successfully Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-4420bba3-48db-4202-9bab-6468f164a4ed-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:36 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-4420bba3-48db-4202-9bab-6468f164a4ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Deleted volume successfully. Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-5ffabad4-8ea2-46a7-9107-78997e09fced tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-80b7d6b6-870a-41ed-beb1-49aff102d8e2-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-quobyte-4420bba3-48db-4202-9bab-6468f164a4ed" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-4420bba3-48db-4202-9bab-6468f164a4ed" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fc9c8-a322-4451-9ad6-57c71cbea11d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:36 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed Sep 01 01:57:36 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 1073741824" returned: 0 in 0.483s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:36 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 Sep 01 01:57:36 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed" returned: 0 in 0.410s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:36 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed Sep 01 01:57:36 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254" returned: 0 in 0.301s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.886s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc16e731-6ce3-4999-adbc-9f8a4e7325a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc6d44e09034355b3837f010397b37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:32Z,use_quota=True,user_id='6aa18bb26d4e44fea69d0f3851f34251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3af3932a-765a-45df-9ccc-aaeb7e1b1586),volume_type_id=3af3932a-765a-45df-9ccc-aaeb7e1b1586)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Creating volume bc16e731-6ce3-4999-adbc-9f8a4e7325a3 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:36 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91382078-acbf-4899-af1d-f81c9dfbf733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43cab189-5d1f-484c-9c9e-d81e1db2f254', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:36 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 1073741824 Sep 01 01:57:36 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5002f754-8008-4d5c-b33c-d084ace3e6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Volume volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 (43cab189-5d1f-484c-9c9e-d81e1db2f254): created successfully Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5002f754-8008-4d5c-b33c-d084ace3e6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (ea3f5c5f-b175-443d-848b-8fccf35f51a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-486e19f5-4497-4b49-bc17-3d7473fdf508 tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:57:37 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4420bba3-48db-4202-9bab-6468f164a4ed" returned: 0 in 0.296s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-4420bba3-48db-4202-9bab-6468f164a4ed" released by "delete_volume" :: held 0.754s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Created reservations ['eaa38308-9a9d-4985-8cde-857590355e9d', '968c4540-91a4-42ae-8509-b2729f905c45', '71e506a9-1b30-46ea-a525-28c6514418e7', '10d90172-4b3b-425f-bdda-0d7511f2bc2e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:37 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:37 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-ac1e7029-f646-4cb6-ad41-a21d04b05efc-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-ac1e7029-f646-4cb6-ad41-a21d04b05efc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-quobyte-ac1e7029-f646-4cb6-ad41-a21d04b05efc" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:37 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 1073741824" returned: 0 in 0.580s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:37 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.305s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-ac1e7029-f646-4cb6-ad41-a21d04b05efc" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:37 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Deleted volume successfully. Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cbf57f-4219-49c5-8683-4532dbdeb2b3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-358ecafb-35b0-40c7-82c4-9e09c2be9e3b tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-4420bba3-48db-4202-9bab-6468f164a4ed-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:37 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 Sep 01 01:57:37 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:37 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc Sep 01 01:57:37 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (ca2479db-a748-483d-84e3-04d789228fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5541ac23-bbe3-4125-bb88-5fb40a4805ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5541ac23-bbe3-4125-bb88-5fb40a4805ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531014122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926cf287-2871-4a22-97f5-9a25a0c429a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:38Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85474943-41b1-4f26-b77a-75847ee4e026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85474943-41b1-4f26-b77a-75847ee4e026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f33cb36-b5e8-4440-9eb8-aa9df9fabd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:37 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f33cb36-b5e8-4440-9eb8-aa9df9fabd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926cf287-2871-4a22-97f5-9a25a0c429a8', 'volume_name': 'volume-926cf287-2871-4a22-97f5-9a25a0c429a8', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b8cb4-7d96-47ff-934b-38ac2ba77d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736b8cb4-7d96-47ff-934b-38ac2ba77d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d755dd6-4bb2-406c-8c55-3fcb247c37a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume 926cf287-2871-4a22-97f5-9a25a0c429a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926cf287-2871-4a22-97f5-9a25a0c429a8', 'volume_size': 1} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc" returned: 0 in 0.505s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3" returned: 0 in 0.507s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531014122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926cf287-2871-4a22-97f5-9a25a0c429a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:38Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Creating volume 926cf287-2871-4a22-97f5-9a25a0c429a8 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:38 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc Sep 01 01:57:38 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:38 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 1073741824 Sep 01 01:57:38 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Attempting download of ba83f621-507b-4faa-8b5c-97243bd67c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/ba83f621-507b-4faa-8b5c-97243bd67c21', 'metadata': {}}])) to volume bc16e731-6ce3-4999-adbc-9f8a4e7325a3. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1173ec6-4a68-4ddd-987f-b2f9a4923192]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba83f621-507b-4faa-8b5c-97243bd67c21_f7j2ihy_ {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba83f621-507b-4faa-8b5c-97243bd67c21_f7j2ihy_ Sep 01 01:57:38 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:38 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ac1e7029-f646-4cb6-ad41-a21d04b05efc" returned: 0 in 0.430s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-ac1e7029-f646-4cb6-ad41-a21d04b05efc" released by "delete_volume" :: held 1.014s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (2699410f-5bff-4bff-a8a9-f5a021dd6e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b6fc46-2c2c-408a-b600-390cbd710147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b6fc46-2c2c-408a-b600-390cbd710147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322638258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5279b337-a33d-4169-be12-e8a695ce832e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:38Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c9b59-c6bb-48c5-8cef-ba1faff887b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c9b59-c6bb-48c5-8cef-ba1faff887b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94efb42a-f198-4021-9bde-19896dec7e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94efb42a-f198-4021-9bde-19896dec7e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5279b337-a33d-4169-be12-e8a695ce832e', 'volume_name': 'volume-5279b337-a33d-4169-be12-e8a695ce832e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc191b9-65d5-45af-92f2-52f08ee7fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc191b9-65d5-45af-92f2-52f08ee7fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c43028-a95c-4ea1-97fd-53a9037f79ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume 5279b337-a33d-4169-be12-e8a695ce832e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5279b337-a33d-4169-be12-e8a695ce832e', 'volume_size': 1} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Created reservations ['582848e7-50be-4b7a-ad55-49f0aaf0b558', '481ada37-30bf-4df1-bab7-89c2955efed8', '02832433-486a-43e4-8637-874768263fa0', '622bcd09-94de-4b15-acfb-aecbeed2c226'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba83f621-507b-4faa-8b5c-97243bd67c21_f7j2ihy_" returned: 0 in 0.535s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba83f621-507b-4faa-8b5c-97243bd67c21_f7j2ihy_ {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:38 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:38 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:38 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 1073741824" returned: 0 in 0.828s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:38 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba83f621-507b-4faa-8b5c-97243bd67c21_f7j2ihy_ Sep 01 01:57:38 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:39 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 Sep 01 01:57:39 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:39 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.320s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Deleted volume successfully. Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (f8963f53-ff0c-4a34-9a91-3fd154264a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029083ab-ebfb-43b4-9269-b56f1a093a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029083ab-ebfb-43b4-9269-b56f1a093a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918542864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330c43a-d863-45fb-b922-84d3b159298d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:39Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3604dc-631c-4ea1-9ad9-4431c6f881f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3604dc-631c-4ea1-9ad9-4431c6f881f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acccd56-7587-4e06-bbad-d6837f5bf7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acccd56-7587-4e06-bbad-d6837f5bf7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4330c43a-d863-45fb-b922-84d3b159298d', 'volume_name': 'volume-4330c43a-d863-45fb-b922-84d3b159298d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74210b88-4555-40c2-8980-9afbb6902760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74210b88-4555-40c2-8980-9afbb6902760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f81bd84-f6f3-4634-b7bb-bec5daaf6a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume 4330c43a-d863-45fb-b922-84d3b159298d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4330c43a-d863-45fb-b922-84d3b159298d', 'volume_size': 1} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8" returned: 0 in 0.314s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-322638258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5279b337-a33d-4169-be12-e8a695ce832e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:38Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Creating volume 5279b337-a33d-4169-be12-e8a695ce832e {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:39 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d26a195-a3d7-43f3-9aaf-ef1e615c2786 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-ac1e7029-f646-4cb6-ad41-a21d04b05efc-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:39 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e 1073741824 Sep 01 01:57:39 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d755dd6-4bb2-406c-8c55-3fcb247c37a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926cf287-2871-4a22-97f5-9a25a0c429a8', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e7764-ff48-4750-9655-aef42d6655b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba83f621-507b-4faa-8b5c-97243bd67c21_f7j2ihy_" returned: 1 in 0.580s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba83f621-507b-4faa-8b5c-97243bd67c21_f7j2ihy_' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:57:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume volume-926cf287-2871-4a22-97f5-9a25a0c429a8 (926cf287-2871-4a22-97f5-9a25a0c429a8): created successfully Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce9e7764-ff48-4750-9655-aef42d6655b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (ca2479db-a748-483d-84e3-04d789228fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd6fa3f-24b0-4eaf-8272-f8617f24dc2c]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5bc378b9-a937-4a96-aabd-8c17cde5ea7a tempest-CreateVolumesFromSnapshotTest-874910766 None] Created volume successfully. Sep 01 01:57:39 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD Sep 01 01:57:39 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (8df431f1-cfaf-478f-9753-ffdea252821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e3dbbd-cfc5-4d69-bf32-8a55648d4c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e3dbbd-cfc5-4d69-bf32-8a55648d4c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-117662912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846252ea-e3fc-4c3b-882a-e60cae8b07ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:40Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613559eb-ad6a-49a1-a4c6-73ee90034dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (613559eb-ad6a-49a1-a4c6-73ee90034dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c908b07-cd5c-4685-be93-09d7ab14c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c908b07-cd5c-4685-be93-09d7ab14c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846252ea-e3fc-4c3b-882a-e60cae8b07ba', 'volume_name': 'volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f57de01-09ac-4bfd-8401-c91d9af0ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f57de01-09ac-4bfd-8401-c91d9af0ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2960caab-0e5c-44e5-aff3-2a9dec065d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:39 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume 846252ea-e3fc-4c3b-882a-e60cae8b07ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba', 'volume_size': 1} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-1ef8edcb-25a5-416a-8da1-093649a55bf4-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-1ef8edcb-25a5-416a-8da1-093649a55bf4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-quobyte-1ef8edcb-25a5-416a-8da1-093649a55bf4" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-1ef8edcb-25a5-416a-8da1-093649a55bf4" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[29336cac-72cc-4f46-b670-9467be6b6e33]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:39 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:39 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e 1073741824" returned: 0 in 0.661s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:40 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 Sep 01 01:57:40 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:40 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e Sep 01 01:57:40 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD Sep 01 01:57:40 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (e1fa0381-d8ef-474f-88aa-ba3e908c0257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a292fccd-9fbe-4f02-97ae-3640e72ac56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a292fccd-9fbe-4f02-97ae-3640e72ac56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217141929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f219f063-e4cd-4818-ad87-381236566916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:40Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6015c0-2783-4536-be2c-5fbb4a9190c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6015c0-2783-4536-be2c-5fbb4a9190c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a28d335-25c1-4b1e-9da5-e0a4e6163172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a28d335-25c1-4b1e-9da5-e0a4e6163172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f219f063-e4cd-4818-ad87-381236566916', 'volume_name': 'volume-f219f063-e4cd-4818-ad87-381236566916', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4a9642-bacf-4f52-9be3-566bb7b95bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4a9642-bacf-4f52-9be3-566bb7b95bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3322e1c-47ad-4984-94a4-07adbb6fc890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:40 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume f219f063-e4cd-4818-ad87-381236566916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f219f063-e4cd-4818-ad87-381236566916', 'volume_size': 1} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:40 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e" returned: 0 in 0.276s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.559s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:40 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Creating offline snapshot 27ead9e5-81a8-4013-af68-0eadcbcaa6f8 of volume 43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:57:40 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c43028-a95c-4ea1-97fd-53a9037f79ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5279b337-a33d-4169-be12-e8a695ce832e', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9793abb3-c874-4daa-ba06-982815b10b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b83bed0-360a-46cd-8131-16fb5eaad929]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4" returned: 0 in 0.483s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] ba83f621-507b-4faa-8b5c-97243bd67c21 was raw, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:40 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4 Sep 01 01:57:40 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume volume-5279b337-a33d-4169-be12-e8a695ce832e (5279b337-a33d-4169-be12-e8a695ce832e): created successfully Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9793abb3-c874-4daa-ba06-982815b10b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:40 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 Sep 01 01:57:40 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (2699410f-5bff-4bff-a8a9-f5a021dd6e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:40 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2d21ca71-d1aa-4c0f-bec6-74ee284615fd tempest-CreateVolumesFromSnapshotTest-874910766 None] Created volume successfully. Sep 01 01:57:40 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 Sep 01 01:57:40 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1ef8edcb-25a5-416a-8da1-093649a55bf4" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-1ef8edcb-25a5-416a-8da1-093649a55bf4" released by "delete_volume" :: held 0.816s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Created reservations ['f561cebb-2af3-44e3-97b2-ca6a51e0dd2c', '5607d189-60b0-4662-8c1b-203112448ce0', 'dede68dc-648a-45d9-92c6-ec9681dc2509', '21520b7a-5981-4750-99f7-a2511f8fb433'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:40 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254" returned: 0 in 0.373s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:40 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 1G Sep 01 01:57:40 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:40 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:40 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3" returned: 0 in 0.524s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba83f621-507b-4faa-8b5c-97243bd67c21_ldzrnauwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:57:40 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:40 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 1G Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-56a1ad65-9106-499b-a5fa-f75c5395a111-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:40 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-56a1ad65-9106-499b-a5fa-f75c5395a111-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "cinder-quobyte-56a1ad65-9106-499b-a5fa-f75c5395a111" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-56a1ad65-9106-499b-a5fa-f75c5395a111" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50ef44-cdb5-4c5c-9728-bc3dc135df18]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:41 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.334s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Deleted volume successfully. Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7d79320c-1e15-4cbe-9e1c-ecb403afa90a tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-1ef8edcb-25a5-416a-8da1-093649a55bf4-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:41 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 1G" returned: 0 in 0.533s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:41 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 Sep 01 01:57:41 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:41 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 Sep 01 01:57:41 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:41 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 1G" returned: 0 in 0.445s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Downloaded image ba83f621-507b-4faa-8b5c-97243bd67c21 ((None, [{'url': 'file:///opt/stack/data/glance/images/ba83f621-507b-4faa-8b5c-97243bd67c21', 'metadata': {}}])) to volume bc16e731-6ce3-4999-adbc-9f8a4e7325a3 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Temporary image ba83f621-507b-4faa-8b5c-97243bd67c21 for user 6aa18bb26d4e44fea69d0f3851f34251 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Marking volume bc16e731-6ce3-4999-adbc-9f8a4e7325a3 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Copying metadata from image ba83f621-507b-4faa-8b5c-97243bd67c21 to bc16e731-6ce3-4999-adbc-9f8a4e7325a3. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Creating volume glance metadata for volume bc16e731-6ce3-4999-adbc-9f8a4e7325a3 backed by image ba83f621-507b-4faa-8b5c-97243bd67c21 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ba83f621-507b-4faa-8b5c-97243bd67c21', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7f23ec40dd113d965c535ac1b1ddb1de', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7d17de5-faed-4031-b12d-2685a13860b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3', 'volume_size': 1, 'image_id': 'ba83f621-507b-4faa-8b5c-97243bd67c21', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba83f621-507b-4faa-8b5c-97243bd67c21', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f23ec40dd113d965c535ac1b1ddb1de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdc6d44e09034355b3837f010397b37a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89e6f7a179a1f56e79ef64ebe6b7dfce8e7601dbca23a50cbd43e9811e82a2579c2534b1fa43e91bfafa21d79f6880f81ea86ad667492a720a89183b10d46e3a', 'id': 'ba83f621-507b-4faa-8b5c-97243bd67c21', 'created_at': datetime.datetime(2026, 8, 31, 23, 57, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 57, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba83f621-507b-4faa-8b5c-97243bd67c21/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e02973-eaf8-40f8-a69a-18932c3da3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:41 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Volume volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 (bc16e731-6ce3-4999-adbc-9f8a4e7325a3): created successfully Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e02973-eaf8-40f8-a69a-18932c3da3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Flow 'volume_create_manager' (67f09c35-6471-49da-ad14-dddcd9e6043b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:41 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-371a5875-42cd-49e8-ad4c-7915c0334b8a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Created volume successfully. Sep 01 01:57:41 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111" returned: 0 in 0.433s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:41 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111 Sep 01 01:57:41 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:41 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8" returned: 0 in 0.339s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:41 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 is being set with open permissions: ugo+rw Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:41 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 Sep 01 01:57:41 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:41 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-56a1ad65-9106-499b-a5fa-f75c5395a111" returned: 0 in 0.241s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-quobyte-56a1ad65-9106-499b-a5fa-f75c5395a111" released by "delete_volume" :: held 0.730s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:41 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8" returned: 0 in 0.242s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Created reservations ['3b9a847f-ded6-42fc-ade1-e5981ca98c2e', 'f98c62c2-8a6a-4c01-b21d-bb118168720c', '5394e544-63d0-4f96-9982-9d2a11a492aa', 'f92125c9-506e-48ec-ba90-5a91fe839175'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:41 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.info Sep 01 01:57:41 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:41 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:41 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.info" returned: 0 in 0.279s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.info is being set with open permissions: ugo+rw Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:42 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.info Sep 01 01:57:42 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.255s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Acquiring lock "cinder-bc16e731-6ce3-4999-adbc-9f8a4e7325a3-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Deleted volume successfully. Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-804030f1-f357-4f35-a0a6-70cc1cd82c61 tempest-CreateVolumesFromImageTest-2054535062 None] Lock "cinder-56a1ad65-9106-499b-a5fa-f75c5395a111-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "cinder-bc16e731-6ce3-4999-adbc-9f8a4e7325a3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Acquiring lock "cinder-quobyte-bc16e731-6ce3-4999-adbc-9f8a4e7325a3" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "cinder-quobyte-bc16e731-6ce3-4999-adbc-9f8a4e7325a3" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c30b2-6fa7-4152-8915-d67d8ea5dc36]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:42 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 Sep 01 01:57:42 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.info" returned: 0 in 0.346s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.235s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918542864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4330c43a-d863-45fb-b922-84d3b159298d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:39Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Creating volume 4330c43a-d863-45fb-b922-84d3b159298d {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:42 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:42 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d 1073741824 Sep 01 01:57:42 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b3f9b25b-f3b2-4c62-a05e-d0ebafe43404 tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:57:42 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3" returned: 0 in 0.433s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:42 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3 Sep 01 01:57:42 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:43 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d 1073741824" returned: 0 in 0.514s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:43 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-bc16e731-6ce3-4999-adbc-9f8a4e7325a3" returned: 0 in 0.277s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "cinder-quobyte-bc16e731-6ce3-4999-adbc-9f8a4e7325a3" released by "delete_volume" :: held 0.757s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:43 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d Sep 01 01:57:43 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Created reservations ['c647c1b6-c768-4f92-91dd-e62b6b69ef84', '043c96cc-6050-4efb-a544-18fd4f09f90d', '18853b58-f92b-4134-b541-b3b9a8c174d5', '15dbd121-753f-4221-96d5-6f97b521d6f5'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:43 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:43 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:43 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d" returned: 0 in 0.322s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.711s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-117662912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846252ea-e3fc-4c3b-882a-e60cae8b07ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:40Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Creating volume 846252ea-e3fc-4c3b-882a-e60cae8b07ba {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:43 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f81bd84-f6f3-4634-b7bb-bec5daaf6a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4330c43a-d863-45fb-b922-84d3b159298d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:43 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba 1073741824 Sep 01 01:57:43 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f378a3cd-02d2-4c73-97d5-44889ef8ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume volume-4330c43a-d863-45fb-b922-84d3b159298d (4330c43a-d863-45fb-b922-84d3b159298d): created successfully Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f378a3cd-02d2-4c73-97d5-44889ef8ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (f8963f53-ff0c-4a34-9a91-3fd154264a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8d63f410-8724-466b-87d8-30185584f4fb tempest-CreateVolumesFromSnapshotTest-874910766 None] Created volume successfully. Sep 01 01:57:43 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.416s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Deleted volume successfully. Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a112f2d0-90ab-46b7-92a0-f447a506ce2a tempest-VolumeAndVolumeTypeFromImageTest-681185353 None] Lock "cinder-bc16e731-6ce3-4999-adbc-9f8a4e7325a3-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-27ead9e5-81a8-4013-af68-0eadcbcaa6f8-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Lock "cinder-27ead9e5-81a8-4013-af68-0eadcbcaa6f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-43cab189-5d1f-484c-9c9e-d81e1db2f254" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-43cab189-5d1f-484c-9c9e-d81e1db2f254" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-27ead9e5-81a8-4013-af68-0eadcbcaa6f8" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-27ead9e5-81a8-4013-af68-0eadcbcaa6f8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot 27ead9e5-81a8-4013-af68-0eadcbcaa6f8 of volume 43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b94c3-e44c-49e0-b41d-5fc3207570c1]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:43 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 Sep 01 01:57:43 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:44 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba 1073741824" returned: 0 in 0.597s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:44 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba Sep 01 01:57:44 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:44 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8" returned: 0 in 0.458s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43cab189-5d1f-484c-9c9e-d81e1db2f254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8a316e-ddcf-4737-9117-ac7e788978dd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:44 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.181s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1217141929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f219f063-e4cd-4818-ad87-381236566916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='951511e79d1b4d4dafc4be84d36b970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:40Z,use_quota=True,user_id='d3f48213550c4b85a6115ded5bf0566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Creating volume f219f063-e4cd-4818-ad87-381236566916 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:44 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2960caab-0e5c-44e5-aff3-2a9dec065d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea35948-e292-4307-94fb-be31bdcb8f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:44 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 1073741824 Sep 01 01:57:44 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:44 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba (846252ea-e3fc-4c3b-882a-e60cae8b07ba): created successfully Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea35948-e292-4307-94fb-be31bdcb8f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (8df431f1-cfaf-478f-9753-ffdea252821e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-91831a45-1b5d-4513-a4fd-88e7d2094977 tempest-CreateVolumesFromSnapshotTest-874910766 None] Created volume successfully. Sep 01 01:57:44 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 Sep 01 01:57:44 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:44 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254" returned: 0 in 0.554s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:44 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 Sep 01 01:57:44 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:45 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 1073741824" returned: 0 in 0.608s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:45 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 Sep 01 01:57:45 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:45 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:45 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8 Sep 01 01:57:45 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:45 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916" returned: 0 in 0.355s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3322e1c-47ad-4984-94a4-07adbb6fc890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f219f063-e4cd-4818-ad87-381236566916', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98256cf8-fb0b-4e1f-8a28-0ee950bcf275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:45 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Volume volume-f219f063-e4cd-4818-ad87-381236566916 (f219f063-e4cd-4818-ad87-381236566916): created successfully Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98256cf8-fb0b-4e1f-8a28-0ee950bcf275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Flow 'volume_create_manager' (e1fa0381-d8ef-474f-88aa-ba3e908c0257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-71eefb49-d84c-4d97-a35e-f12dc5c68e30 tempest-CreateVolumesFromSnapshotTest-874910766 None] Created volume successfully. Sep 01 01:57:45 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254.27ead9e5-81a8-4013-af68-0eadcbcaa6f8" returned: 0 in 0.299s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-27ead9e5-81a8-4013-af68-0eadcbcaa6f8" released by "_delete_snapshot" :: held 1.861s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-43cab189-5d1f-484c-9c9e-d81e1db2f254" released by "delete_snapshot" :: held 1.890s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Created reservations ['caf571d4-5432-4d8e-bbf2-363a7419f914', '23e55d86-ea11-4d16-a718-8a507d551a60', '147bcf17-c48f-44a8-9890-5bc4fa7fe241', '63af42e9-19c8-4674-8697-4651a7b8481b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:45 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e1a451db-6d0e-43df-a8c5-e867b3a0aa87 tempest-ProjectMemberTests-671459076 None] Lock "cinder-27ead9e5-81a8-4013-af68-0eadcbcaa6f8-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-43cab189-5d1f-484c-9c9e-d81e1db2f254-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-f219f063-e4cd-4818-ad87-381236566916-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-43cab189-5d1f-484c-9c9e-d81e1db2f254-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-f219f063-e4cd-4818-ad87-381236566916-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-43cab189-5d1f-484c-9c9e-d81e1db2f254" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-43cab189-5d1f-484c-9c9e-d81e1db2f254" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Flow 'volume_create_manager' (6c3cec49-b885-4ad5-9de5-e99ec7626493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006f93b7-47c0-4f9f-9984-6cd992d354d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d2123a-6ce4-44c6-8f66-aef439538c8a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-f219f063-e4cd-4818-ad87-381236566916" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006f93b7-47c0-4f9f-9984-6cd992d354d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-402580928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9babe478-0a36-45bb-b7e4-659a650c8976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7932009f0548c2b32e3e5e93400cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:46Z,use_quota=True,user_id='cad2967e558a4f0bbc200248174364ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c3cb5d-bddc-4226-a758-5e1028e6de3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c3cb5d-bddc-4226-a758-5e1028e6de3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e13553c-072d-4036-beb6-247b9eb347e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e13553c-072d-4036-beb6-247b9eb347e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9babe478-0a36-45bb-b7e4-659a650c8976', 'volume_name': 'volume-9babe478-0a36-45bb-b7e4-659a650c8976', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118b4670-2674-408e-aa47-ac929500e565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118b4670-2674-408e-aa47-ac929500e565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4517d578-5522-4d41-bb3d-e1d2ec21655c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:46 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Volume 9babe478-0a36-45bb-b7e4-659a650c8976: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9babe478-0a36-45bb-b7e4-659a650c8976', 'volume_size': 1} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-402580928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9babe478-0a36-45bb-b7e4-659a650c8976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7932009f0548c2b32e3e5e93400cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:46Z,use_quota=True,user_id='cad2967e558a4f0bbc200248174364ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Creating volume 9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:46 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-f219f063-e4cd-4818-ad87-381236566916" acquired by "delete_volume" :: waited 0.086s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:46 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 1073741824 Sep 01 01:57:46 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdb4768-4116-4e00-b73a-7b08ec20bca5]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:46 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 Sep 01 01:57:46 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:46 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 Sep 01 01:57:46 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:46 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254" returned: 0 in 0.484s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:46 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254 Sep 01 01:57:46 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:46 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916" returned: 0 in 0.453s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:46 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 1073741824" returned: 0 in 0.511s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:46 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916 Sep 01 01:57:46 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:46 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 Sep 01 01:57:46 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:46 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-43cab189-5d1f-484c-9c9e-d81e1db2f254" returned: 0 in 0.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-43cab189-5d1f-484c-9c9e-d81e1db2f254" released by "delete_volume" :: held 0.877s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:47 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f219f063-e4cd-4818-ad87-381236566916" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Created reservations ['c300d42c-d15a-4953-9581-4823034c3009', '80e01a1f-ab23-44a7-9064-4dbab270682c', '33c4e328-d171-42ec-b988-1342b27bf492', 'e2901a4c-47f0-44ed-a082-a6ea344fcc3c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-f219f063-e4cd-4818-ad87-381236566916" released by "delete_volume" :: held 0.798s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:47 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4517d578-5522-4d41-bb3d-e1d2ec21655c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9babe478-0a36-45bb-b7e4-659a650c8976', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e5c007-986c-49bf-9e52-6cd48e26d43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:47 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Volume volume-9babe478-0a36-45bb-b7e4-659a650c8976 (9babe478-0a36-45bb-b7e4-659a650c8976): created successfully Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e5c007-986c-49bf-9e52-6cd48e26d43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:47 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:47 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Flow 'volume_create_manager' (6c3cec49-b885-4ad5-9de5-e99ec7626493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Created reservations ['5998da15-20fa-4193-8e94-5d734055f066', 'a3d36a43-f4aa-4e90-b704-ad04cd6f5fc4', 'a13aaf36-cc8c-440f-99f8-d3dd30231225', '02d02b24-627d-45b5-a811-75c448186ea3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9fd54803-dbea-48fe-8259-4f6c39ab1d0c tempest-VolumeDependencyTests-128704454 None] Created volume successfully. Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:47 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:47 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:47 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.333s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9271fcf8-62e4-4916-a75a-61a06426b7a9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-43cab189-5d1f-484c-9c9e-d81e1db2f254-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:47 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.348s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Deleted volume successfully. Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (7cdb45d4-2be6-41fb-8d2b-27c4a0f4610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffd1478-f39f-4bba-8478-3fbdc85803cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-1567a879-79c9-4349-ba93-50e74a53df2a tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-f219f063-e4cd-4818-ad87-381236566916-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffd1478-f39f-4bba-8478-3fbdc85803cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504733582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c38bb6-6618-4f30-a5e5-7ebffa1c1431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:48Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad1d844-61f4-4d9a-88e7-909837730537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad1d844-61f4-4d9a-88e7-909837730537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8031ebb-d92d-416f-82e7-7802e03e90c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8031ebb-d92d-416f-82e7-7802e03e90c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c38bb6-6618-4f30-a5e5-7ebffa1c1431', 'volume_name': 'volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2ed244-3dbf-4ac2-b14d-52163a4df795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2ed244-3dbf-4ac2-b14d-52163a4df795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996fdb8c-cff1-4ed8-a9cf-7cedb225e63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:47 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Volume a6c38bb6-6618-4f30-a5e5-7ebffa1c1431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431', 'volume_size': 1} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504733582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c38bb6-6618-4f30-a5e5-7ebffa1c1431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:48Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Creating volume a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:47 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:57:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:47 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 1073741824 Sep 01 01:57:47 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-846252ea-e3fc-4c3b-882a-e60cae8b07ba-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-846252ea-e3fc-4c3b-882a-e60cae8b07ba-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-846252ea-e3fc-4c3b-882a-e60cae8b07ba" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-846252ea-e3fc-4c3b-882a-e60cae8b07ba" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2562894a-c997-440e-bef4-866f930b206b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:48 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 1073741824" returned: 0 in 0.544s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:48 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 Sep 01 01:57:48 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:48 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba Sep 01 01:57:48 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:48 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" returned: 0 in 0.255s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.423s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996fdb8c-cff1-4ed8-a9cf-7cedb225e63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df68a6b-f765-43eb-a4bc-8ddee8f9c4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Creating offline snapshot f7fa6274-c75b-4f7d-a37a-665c28af870d of volume 9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:57:48 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:48 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Volume volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 (a6c38bb6-6618-4f30-a5e5-7ebffa1c1431): created successfully Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df68a6b-f765-43eb-a4bc-8ddee8f9c4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (7cdb45d4-2be6-41fb-8d2b-27c4a0f4610b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[af68f606-b970-4391-bda4-991f2fc72242]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba" returned: 0 in 0.427s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c89ea6c1-67f5-4bb0-a7be-e059976bf83d tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:57:48 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba Sep 01 01:57:48 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:48 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 Sep 01 01:57:48 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:49 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-846252ea-e3fc-4c3b-882a-e60cae8b07ba" returned: 0 in 0.258s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-846252ea-e3fc-4c3b-882a-e60cae8b07ba" released by "delete_volume" :: held 0.744s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Created reservations ['82aee595-da94-4b83-bd56-f54197a84941', 'c28d9514-15c2-4825-9a52-24f7d672d283', '9614bd1e-abea-41a2-8912-8b59cefd66c7', 'fda49bbf-6e61-4d7e-b510-f943b427f09b'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:49 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976" returned: 0 in 0.399s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:49 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d 1G Sep 01 01:57:49 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:49 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:49 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-4330c43a-d863-45fb-b922-84d3b159298d-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-4330c43a-d863-45fb-b922-84d3b159298d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-4330c43a-d863-45fb-b922-84d3b159298d" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:49 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.326s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-4330c43a-d863-45fb-b922-84d3b159298d" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Deleted volume successfully. Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d568e99c-1ad4-4d5b-8670-729bdfd3db65]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-98f1b605-aa1a-4a01-ac2e-f2e8fc40d34e tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-846252ea-e3fc-4c3b-882a-e60cae8b07ba-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:49 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d 1G" returned: 0 in 0.472s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9babe478-0a36-45bb-b7e4-659a650c8976 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:49 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9babe478-0a36-45bb-b7e4-659a650c8976 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d Sep 01 01:57:49 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:49 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d Sep 01 01:57:49 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:50 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9babe478-0a36-45bb-b7e4-659a650c8976 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d" returned: 0 in 0.343s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:50 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d is being set with open permissions: ugo+rw Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:50 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d" returned: 0 in 0.452s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:50 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d Sep 01 01:57:50 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:50 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d Sep 01 01:57:50 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:50 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4330c43a-d863-45fb-b922-84d3b159298d" returned: 0 in 0.271s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:50 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d" returned: 0 in 0.321s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-4330c43a-d863-45fb-b922-84d3b159298d" released by "delete_volume" :: held 0.773s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:50 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.info Sep 01 01:57:50 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Created reservations ['5eda1ec0-1df4-4336-9e61-44e003d4a242', 'ff454886-764c-4a18-97a1-4d4e22059e95', 'cb5005f4-665e-4e5d-9597-ba9530019e91', '70f2a635-eae4-422f-94a9-135adcd646f1'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:50 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:50 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-5279b337-a33d-4169-be12-e8a695ce832e-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-5279b337-a33d-4169-be12-e8a695ce832e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:50 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.info" returned: 0 in 0.311s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:50 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.info is being set with open permissions: ugo+rw Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-5279b337-a33d-4169-be12-e8a695ce832e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:50 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.info Sep 01 01:57:50 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-5279b337-a33d-4169-be12-e8a695ce832e" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5b041e-1701-4f4d-ada4-7bc9b3f445aa]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:50 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.284s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Deleted volume successfully. Sep 01 01:57:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3af36038-d1b7-42ac-a7b3-45cb95ab55b3 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-4330c43a-d863-45fb-b922-84d3b159298d-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:50 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e Sep 01 01:57:50 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:51 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.info" returned: 0 in 0.270s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.673s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Creating offline snapshot 510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 of volume a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a98e8-d83a-47c5-bbf8-d3960abc2239]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:51 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5ce2a1b2-8522-464b-b0f0-14a7b54b549b tempest-VolumeDependencyTests-128704454 None] Create snapshot completed successfully Sep 01 01:57:51 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e" returned: 0 in 0.393s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:51 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 Sep 01 01:57:51 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:51 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e Sep 01 01:57:51 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:51 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-5279b337-a33d-4169-be12-e8a695ce832e" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:51 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-5279b337-a33d-4169-be12-e8a695ce832e" released by "delete_volume" :: held 0.792s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" returned: 0 in 0.503s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:51 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 1G Sep 01 01:57:51 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Created reservations ['2f5d6948-e208-450f-a4d7-967181da8e3e', '280425db-1c09-4f5a-b8e4-1a387272edd6', 'bffff69d-0b1c-4cd0-b172-cbd4bde656b3', '08104469-e117-4fc7-9069-eacc894a0e71'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:51 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:51 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-926cf287-2871-4a22-97f5-9a25a0c429a8-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-926cf287-2871-4a22-97f5-9a25a0c429a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-926cf287-2871-4a22-97f5-9a25a0c429a8" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-926cf287-2871-4a22-97f5-9a25a0c429a8" acquired by "delete_volume" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:52 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9febbe0f-44ff-48ea-b2a6-c30c8be88777]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:52 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.441s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 1G" returned: 0 in 0.630s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:52 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Deleted volume successfully. Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f155b981-103e-4a95-9ccf-db022145e723 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-5279b337-a33d-4169-be12-e8a695ce832e-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:52 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 Sep 01 01:57:52 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:57:52 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 Sep 01 01:57:52 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Flow 'volume_create_manager' (bbee8046-1393-4c91-b679-e4933696e857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf30b23d-52e6-4869-87d5-3cf483b17bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf30b23d-52e6-4869-87d5-3cf483b17bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1256547683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd1f3c5-aaf7-404a-b585-d584350722ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7932009f0548c2b32e3e5e93400cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7fa6274-c75b-4f7d-a37a-665c28af870d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:57:52Z,use_quota=True,user_id='cad2967e558a4f0bbc200248174364ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42821810-cc1d-4389-a2c0-2de67a398843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42821810-cc1d-4389-a2c0-2de67a398843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8acb4d0-b18e-48c6-859d-59da95a389c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8acb4d0-b18e-48c6-859d-59da95a389c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8fd1f3c5-aaf7-404a-b585-d584350722ae', 'volume_name': 'volume-8fd1f3c5-aaf7-404a-b585-d584350722ae', 'volume_size': 1, 'snapshot_id': 'f7fa6274-c75b-4f7d-a37a-665c28af870d'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d314250-8304-4eba-9a33-607f3ceee2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d314250-8304-4eba-9a33-607f3ceee2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374b9534-e04d-4e9d-bf39-dd47b2d6478f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:57:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Volume 8fd1f3c5-aaf7-404a-b585-d584350722ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8fd1f3c5-aaf7-404a-b585-d584350722ae', 'volume_size': 1, 'snapshot_id': 'f7fa6274-c75b-4f7d-a37a-665c28af870d'} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:52 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" returned: 0 in 0.402s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:52 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 is being set with open permissions: ugo+rw Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:52 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 Sep 01 01:57:52 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:52 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8" returned: 0 in 0.511s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:52 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8 Sep 01 01:57:52 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:52 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" returned: 0 in 0.240s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:52 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-926cf287-2871-4a22-97f5-9a25a0c429a8" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-926cf287-2871-4a22-97f5-9a25a0c429a8" released by "delete_volume" :: held 0.865s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:53 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.info Sep 01 01:57:53 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Created reservations ['e403d420-cde7-41fb-9e5c-078f67a05b77', 'd8930a92-6287-470f-9df2-1ce52f8c9aa5', '03eefbf0-fd71-41b9-9b4d-0ec0823cf25d', '1495ba79-85d5-43c9-b7c7-8460fbeb9f9d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:53 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:53 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:53 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.info" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:53 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.info is being set with open permissions: ugo+rw Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:53 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.info Sep 01 01:57:53 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-276704a1-ec54-4d3e-8404-977ed517b91e" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-276704a1-ec54-4d3e-8404-977ed517b91e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Deleting offline snapshot 80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d of volume 276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] snapshot_file for this snap is: volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e187c3-eac4-4a0e-9483-c66e4a4cf889]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:53 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.292s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Deleted volume successfully. Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4e8b2f21-f982-4c9a-a1fd-ce34183491ac tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-926cf287-2871-4a22-97f5-9a25a0c429a8-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:53 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d Sep 01 01:57:53 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:53 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.info" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.038s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-quobyte-f7fa6274-c75b-4f7d-a37a-665c28af870d-8fd1f3c5-aaf7-404a-b585-d584350722ae" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-f7fa6274-c75b-4f7d-a37a-665c28af870d-8fd1f3c5-aaf7-404a-b585-d584350722ae" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Creating volume 8fd1f3c5-aaf7-404a-b585-d584350722ae from snapshot f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-quobyte-8fd1f3c5-aaf7-404a-b585-d584350722ae" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-81c1be9d-0b6f-4a26-bda6-482d924dc7a1 tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-8fd1f3c5-aaf7-404a-b585-d584350722ae" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] snapshot: f7fa6274-c75b-4f7d-a37a-665c28af870d, volume: 8fd1f3c5-aaf7-404a-b585-d584350722ae, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bfe2d-aed4-4453-8831-55fb6a64ed0c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:53 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" returned: 0 in 0.402s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276704a1-ec54-4d3e-8404-977ed517b91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:57:53 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d Sep 01 01:57:53 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2cf569-41ff-4159-84ed-c92c9f9b53e3]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:53 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e Sep 01 01:57:53 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:54 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d" returned: 0 in 0.386s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9babe478-0a36-45bb-b7e4-659a650c8976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a15e878-9c54-4bac-9933-dc0f5f49df33]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:54 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 Sep 01 01:57:54 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:54 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e" returned: 0 in 0.412s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:54 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d Sep 01 01:57:54 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-510ad8c6-939f-4baa-a3b5-c82fb3fb87b1-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Lock "cinder-510ad8c6-939f-4baa-a3b5-c82fb3fb87b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot 510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 of volume a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:57:54 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976" returned: 0 in 0.483s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[aede78fe-dcdb-422d-8ab7-a58e719fb7c0]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:54 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae Sep 01 01:57:54 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:54 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" returned: 0 in 0.461s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:54 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d Sep 01 01:57:54 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:54 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 Sep 01 01:57:54 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:55 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e.80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" returned: 0 in 0.305s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:55 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" returned: 0 in 0.412s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2de778-aa16-4ccb-b8a0-7a6c790006f6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d" released by "_delete_snapshot" :: held 1.731s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-276704a1-ec54-4d3e-8404-977ed517b91e" released by "delete_snapshot" :: held 1.757s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Created reservations ['e9aedc60-b79a-49fb-987b-c5f286a8dee6', '7dc5107d-095e-4841-92e9-708aa2b87170', '5faca322-901d-4fe7-b278-3701a8133d67', 'd95d85c8-75cf-4bee-b4b7-f06207f563a4'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:55 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 Sep 01 01:57:55 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:55 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Delete snapshot completed successfully. Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a3991857-6baa-42af-9af7-76bc3f97acfc tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-80b8d32e-0aea-49f6-a190-b6ae3ae0ad1d-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-276704a1-ec54-4d3e-8404-977ed517b91e-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-276704a1-ec54-4d3e-8404-977ed517b91e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:55 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "cinder-quobyte-276704a1-ec54-4d3e-8404-977ed517b91e" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" returned: 0 in 0.899s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:56 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 Sep 01 01:57:56 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:56 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-276704a1-ec54-4d3e-8404-977ed517b91e" acquired by "delete_volume" :: waited 0.101s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:56 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e665821-9058-4dfa-bbd5-bbbf522b5f81]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:56 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e Sep 01 01:57:56 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:56 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e" returned: 0 in 0.764s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:57 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:57 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e Sep 01 01:57:57 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" returned: 0 in 1.047s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:57 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1 Sep 01 01:57:57 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:57 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431.510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" returned: 0 in 0.476s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-510ad8c6-939f-4baa-a3b5-c82fb3fb87b1" released by "_delete_snapshot" :: held 3.089s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" released by "delete_snapshot" :: held 3.145s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:57 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-276704a1-ec54-4d3e-8404-977ed517b91e" returned: 0 in 0.809s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-quobyte-276704a1-ec54-4d3e-8404-977ed517b91e" released by "delete_volume" :: held 1.763s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Created reservations ['e8a62a28-0fbb-4283-9069-e0e4bfb3855f', '439f45a9-572f-4af0-a8c1-0cc2098adc80', '1011c8e0-5ee2-4db7-8074-d95251d7ceb4', 'df301d0f-e9bd-49dc-86ee-22193179057e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:57 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Created reservations ['020dfdbd-9e31-43fe-a1bc-af5dce0b1e3c', 'bec6a072-647e-4b1a-86e8-6aa90ebe4f37', '4922c0e9-c6c8-4b52-8aeb-736747eb914b', '0e83f8de-5aec-4506-9c2c-b0e9c20ecfa9'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:57:58 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7b5756f8-cf2e-4c23-9850-50bb4f88a953 tempest-ProjectMemberTests-671459076 None] Lock "cinder-510ad8c6-939f-4baa-a3b5-c82fb3fb87b1-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:58 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:57:58 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:58 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.578s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:58 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Deleted volume successfully. Sep 01 01:57:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-6fe0eb24-6d06-4e82-8fad-1e3a41083739 tempest-CreateVolumesFromSnapshotTest-874910766 None] Lock "cinder-276704a1-ec54-4d3e-8404-977ed517b91e-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:57:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Lock "cinder-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:57:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" acquired by "delete_volume" :: waited 0.042s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:57:59 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47a1d9-d316-410f-b953-aa80cc0f3d57]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:57:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:59 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 Sep 01 01:57:59 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:00 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" returned: 0 in 0.843s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:00 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431 Sep 01 01:58:00 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:00 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae" returned: 0 in 6.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:00 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:58:00 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Converted 1024.00 MB image at 162.36 MB/s Sep 01 01:58:00 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae is being set with open permissions: ugo+rw Sep 01 01:58:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:00 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae Sep 01 01:58:00 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:00 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" returned: 0 in 0.470s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431" released by "delete_volume" :: held 1.488s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Created reservations ['aff75e9f-81ca-4d77-92ed-2217cafad85c', 'bef53176-bcfa-4c18-9c3f-1b6c6c7f5303', 'ebc7d8b5-1f0b-4301-a470-879d08e9e6d8', '07505cfe-0262-4f6e-acec-442ede4e3e6d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:01 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:01 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:01 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae" returned: 0 in 0.347s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-8fd1f3c5-aaf7-404a-b585-d584350722ae" released by "_copy_volume_from_snapshot" :: held 7.620s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-f7fa6274-c75b-4f7d-a37a-665c28af870d-8fd1f3c5-aaf7-404a-b585-d584350722ae" released by "_create_volume_from_snapshot" :: held 7.716s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.736s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374b9534-e04d-4e9d-bf39-dd47b2d6478f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd1f3c5-aaf7-404a-b585-d584350722ae', 'volume_size': 1, 'snapshot_id': 'f7fa6274-c75b-4f7d-a37a-665c28af870d'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efa1c00-dcda-42bf-8a9c-78bb42124db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:01 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Volume volume-8fd1f3c5-aaf7-404a-b585-d584350722ae (8fd1f3c5-aaf7-404a-b585-d584350722ae): created successfully Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efa1c00-dcda-42bf-8a9c-78bb42124db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Flow 'volume_create_manager' (bbee8046-1393-4c91-b679-e4933696e857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0e3b99ad-7f09-4b76-ba9a-3fc5494cc798 tempest-VolumeDependencyTests-128704454 None] Created volume successfully. Sep 01 01:58:01 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.380s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:58:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c79f4cc2-5122-4799-9d19-fdbb6f0d788d tempest-ProjectMemberTests-671459076 None] Lock "cinder-a6c38bb6-6618-4f30-a5e5-7ebffa1c1431-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (787a884c-fa41-48ad-90d2-eab9ec319863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19499f39-8565-43ec-941d-6da8aed4f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19499f39-8565-43ec-941d-6da8aed4f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1843030298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ffb55d-0f28-4e8d-959f-3e0e4a34db93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:02Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41a997f-3538-4ee4-8fab-8285f2feab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41a997f-3538-4ee4-8fab-8285f2feab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac446a68-7e66-4b9d-b29a-012d565c5ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac446a68-7e66-4b9d-b29a-012d565c5ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ffb55d-0f28-4e8d-959f-3e0e4a34db93', 'volume_name': 'volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093569e9-4fdd-467e-8c89-3edd4b905ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093569e9-4fdd-467e-8c89-3edd4b905ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795dd0a0-9b94-4359-a9ee-a2f32c49575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:02 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Volume c7ffb55d-0f28-4e8d-959f-3e0e4a34db93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93', 'volume_size': 1} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1843030298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ffb55d-0f28-4e8d-959f-3e0e4a34db93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:02Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Creating volume c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:02 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:02 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 1073741824 Sep 01 01:58:02 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-f7fa6274-c75b-4f7d-a37a-665c28af870d-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-f7fa6274-c75b-4f7d-a37a-665c28af870d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-quobyte-9babe478-0a36-45bb-b7e4-659a650c8976" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-9babe478-0a36-45bb-b7e4-659a650c8976" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-quobyte-f7fa6274-c75b-4f7d-a37a-665c28af870d" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-f7fa6274-c75b-4f7d-a37a-665c28af870d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Deleting offline snapshot f7fa6274-c75b-4f7d-a37a-665c28af870d of volume 9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] snapshot_file for this snap is: volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf7793f-0c7c-4eaa-9b06-6bd4937dc884]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:02 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d Sep 01 01:58:02 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:03 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 1073741824" returned: 0 in 0.558s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:03 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 Sep 01 01:58:03 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:03 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d" returned: 0 in 0.442s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9babe478-0a36-45bb-b7e4-659a650c8976(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d5df51-de45-4700-9dcd-f799c71bb00b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:03 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 Sep 01 01:58:03 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:03 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" returned: 0 in 0.335s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795dd0a0-9b94-4359-a9ee-a2f32c49575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f9c217-0cda-4399-9de2-ce9ee072b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:03 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Volume volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 (c7ffb55d-0f28-4e8d-959f-3e0e4a34db93): created successfully Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f9c217-0cda-4399-9de2-ce9ee072b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (787a884c-fa41-48ad-90d2-eab9ec319863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:03 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6ed5fcfd-c758-433b-a6b0-cdcac703c32e tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:04 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (63bc6640-f361-4f17-97e1-c993ced43209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3715571d-9851-4ac0-9145-fc57592dabc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976" returned: 0 in 0.714s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3715571d-9851-4ac0-9145-fc57592dabc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-296753951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7967d251-4d09-42a0-96c4-66dd6a0dd86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:04Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:04 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d Sep 01 01:58:04 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea9a7bc-ba01-40ce-bc26-55c9bebc713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea9a7bc-ba01-40ce-bc26-55c9bebc713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acfdd29-aa10-4d90-af4d-cdc9e6d4fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acfdd29-aa10-4d90-af4d-cdc9e6d4fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7967d251-4d09-42a0-96c4-66dd6a0dd86a', 'volume_name': 'volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c17e70-1cd4-4afe-b2d9-99788d14fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c17e70-1cd4-4afe-b2d9-99788d14fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f74006f-90e4-4cff-b612-c4a52387c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume 7967d251-4d09-42a0-96c4-66dd6a0dd86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a', 'volume_size': 1} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-296753951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7967d251-4d09-42a0-96c4-66dd6a0dd86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:04Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Creating volume 7967d251-4d09-42a0-96c4-66dd6a0dd86a {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:04 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:04 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a 1073741824 Sep 01 01:58:04 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:04 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d" returned: 0 in 0.355s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:04 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d Sep 01 01:58:04 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:04 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a 1073741824" returned: 0 in 0.536s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:04 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a Sep 01 01:58:04 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:04 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976.f7fa6274-c75b-4f7d-a37a-665c28af870d" returned: 0 in 0.364s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-f7fa6274-c75b-4f7d-a37a-665c28af870d" released by "_delete_snapshot" :: held 2.057s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-9babe478-0a36-45bb-b7e4-659a650c8976" released by "delete_snapshot" :: held 2.104s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:04 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Created reservations ['25fc995c-a63a-4d73-b81d-ae34a46fc8ae', '1ed09910-79cb-4d04-9687-dff5d175a9e7', '0edc2475-e489-4290-8bd0-3d741402a213', '68334ae6-0a3e-414c-a2c8-0fee87c81c65'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Delete snapshot completed successfully. Sep 01 01:58:05 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cd4a9856-48a0-492e-8ff0-9f297e2597a0 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-f7fa6274-c75b-4f7d-a37a-665c28af870d-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a" returned: 0 in 0.313s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.155s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f74006f-90e4-4cff-b612-c4a52387c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48f8bd5-1656-4015-950b-3beee0548459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Creating offline snapshot fb7749c8-e05f-4960-a74c-6763597d22bf of volume c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:58:05 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a (7967d251-4d09-42a0-96c4-66dd6a0dd86a): created successfully Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48f8bd5-1656-4015-950b-3beee0548459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (63bc6640-f361-4f17-97e1-c993ced43209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa82188e-4a5f-4ba0-a1e4-491713db4f85]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-72c44162-665e-4079-9cf0-7e7c12eeadd9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created volume successfully. Sep 01 01:58:05 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 Sep 01 01:58:05 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:05 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" returned: 0 in 0.402s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:05 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf 1G Sep 01 01:58:05 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:05 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf 1G" returned: 0 in 0.439s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:05 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf Sep 01 01:58:05 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-9babe478-0a36-45bb-b7e4-659a650c8976-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-9babe478-0a36-45bb-b7e4-659a650c8976-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-quobyte-9babe478-0a36-45bb-b7e4-659a650c8976" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-9babe478-0a36-45bb-b7e4-659a650c8976" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc187a1-69a0-4950-9a72-b80580abcf86]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:06 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 Sep 01 01:58:06 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:06 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:06 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf is being set with open permissions: ugo+rw Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:06 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf Sep 01 01:58:06 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (a237fa8e-7e42-4b96-945a-2b37ba02d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5801de04-5567-48e6-882a-2d853e5d4917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:06 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976" returned: 0 in 0.711s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:06 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf" returned: 0 in 0.527s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5801de04-5567-48e6-882a-2d853e5d4917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1342549744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37aac33-f5a7-4aba-8c54-7a717778bc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:07Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16732be-e42d-40a8-8af6-d458d0ba2b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16732be-e42d-40a8-8af6-d458d0ba2b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799741ea-e600-4a19-99e6-5336b7e290d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:06 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976 Sep 01 01:58:06 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799741ea-e600-4a19-99e6-5336b7e290d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c37aac33-f5a7-4aba-8c54-7a717778bc77', 'volume_name': 'volume-c37aac33-f5a7-4aba-8c54-7a717778bc77', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811cbd2d-ed49-44ba-bdf4-5149d2d20648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811cbd2d-ed49-44ba-bdf4-5149d2d20648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73652ef4-809e-4a68-8076-20a9597585a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:06 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume c37aac33-f5a7-4aba-8c54-7a717778bc77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c37aac33-f5a7-4aba-8c54-7a717778bc77', 'volume_size': 1} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:07 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.info Sep 01 01:58:07 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:07 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-9babe478-0a36-45bb-b7e4-659a650c8976" returned: 0 in 0.437s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-9babe478-0a36-45bb-b7e4-659a650c8976" released by "delete_volume" :: held 1.241s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:07 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.info" returned: 0 in 0.382s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:07 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.info is being set with open permissions: ugo+rw Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:07 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.info Sep 01 01:58:07 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Created reservations ['4396109b-6ad9-403b-b91e-d9080bfbe29c', 'e7e1e8ea-b1cc-4377-9503-dd525b3c1a4d', '14faa890-9583-4c5a-abc7-4c241c2d98a5', 'c1b64ebb-8d23-4c8d-99a1-1283f90dd4b8'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (4757c254-15c7-4f7d-95ab-58518aa9ac5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01a71ba-efdc-4a82-8e6d-b702058dbbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01a71ba-efdc-4a82-8e6d-b702058dbbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839125972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea846e1b-e582-4d93-baf4-af4ec3ce58d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:07Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c5c37c-7fed-4509-9e51-6421b4bb6a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c5c37c-7fed-4509-9e51-6421b4bb6a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e11f51f-1834-44c0-88d5-db401e4f7b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e11f51f-1834-44c0-88d5-db401e4f7b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea846e1b-e582-4d93-baf4-af4ec3ce58d9', 'volume_name': 'volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42428068-a774-4518-a250-abd83b22d61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42428068-a774-4518-a250-abd83b22d61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbeb8383-14f7-4437-9f1d-7e57136367ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:07 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume ea846e1b-e582-4d93-baf4-af4ec3ce58d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9', 'volume_size': 1} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:07 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.info" returned: 0 in 0.456s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1342549744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37aac33-f5a7-4aba-8c54-7a717778bc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:07Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Creating volume c37aac33-f5a7-4aba-8c54-7a717778bc77 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:07 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:07 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 1073741824 Sep 01 01:58:07 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6df1a5ee-3800-406d-a67c-106390ef8be3 tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:08 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:08 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (f1ae8a1b-5cbc-43a5-82db-f0f6c346f528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0607fd13-92c6-4182-8236-fc9a73f10050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0607fd13-92c6-4182-8236-fc9a73f10050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131730376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1704189c-038e-4c3c-98e1-14d8c374cd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:08Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c15641e-7bdc-4477-aa13-2bca0a5c43c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c15641e-7bdc-4477-aa13-2bca0a5c43c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01cd9b9-b508-45c1-bf7e-6c69a510be36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01cd9b9-b508-45c1-bf7e-6c69a510be36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1704189c-038e-4c3c-98e1-14d8c374cd47', 'volume_name': 'volume-1704189c-038e-4c3c-98e1-14d8c374cd47', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb6edb4-a88c-4c5a-9905-f4f928efface) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb6edb4-a88c-4c5a-9905-f4f928efface) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d28d17-e6d7-4552-bb5b-fee6b70f813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:08 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume 1704189c-038e-4c3c-98e1-14d8c374cd47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1704189c-038e-4c3c-98e1-14d8c374cd47', 'volume_size': 1} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-8fd1f3c5-aaf7-404a-b585-d584350722ae-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-8fd1f3c5-aaf7-404a-b585-d584350722ae-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:08 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.508s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Deleted volume successfully. Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "cinder-quobyte-8fd1f3c5-aaf7-404a-b585-d584350722ae" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-9e429817-77b5-4b86-9eef-384d908bf165 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-9babe478-0a36-45bb-b7e4-659a650c8976-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-8fd1f3c5-aaf7-404a-b585-d584350722ae" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cceb457-7a74-46b6-878b-9643bff87f09]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:08 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae Sep 01 01:58:08 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:08 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 1073741824" returned: 0 in 0.944s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:08 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:09 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 Sep 01 01:58:09 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (52162ed1-1a8b-4352-ac71-396566a4cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75af458c-bb26-40a3-a097-471195be0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75af458c-bb26-40a3-a097-471195be0653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902735353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf78ecd-ae2c-41a2-bc30-92d973703f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:09Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3add7e9-0e2b-4278-9d55-c6623419cc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3add7e9-0e2b-4278-9d55-c6623419cc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e96321-a717-473d-8579-ab84720c2945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e96321-a717-473d-8579-ab84720c2945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf78ecd-ae2c-41a2-bc30-92d973703f42', 'volume_name': 'volume-daf78ecd-ae2c-41a2-bc30-92d973703f42', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8053977-7403-4f0b-b029-3fa0a0cf02f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8053977-7403-4f0b-b029-3fa0a0cf02f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bca3378-d124-40cc-acec-ce462e1ce90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:09 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume daf78ecd-ae2c-41a2-bc30-92d973703f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf78ecd-ae2c-41a2-bc30-92d973703f42', 'volume_size': 1} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-fb7749c8-e05f-4960-a74c-6763597d22bf-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Lock "cinder-fb7749c8-e05f-4960-a74c-6763597d22bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-fb7749c8-e05f-4960-a74c-6763597d22bf" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-fb7749c8-e05f-4960-a74c-6763597d22bf" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot fb7749c8-e05f-4960-a74c-6763597d22bf of volume c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:09 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae" returned: 0 in 0.844s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:09 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc5a08f-aae8-4cd4-96ea-5b127dfc4f1c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77" returned: 0 in 0.611s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:09 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae Sep 01 01:58:09 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1839125972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea846e1b-e582-4d93-baf4-af4ec3ce58d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:07Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Creating volume ea846e1b-e582-4d93-baf4-af4ec3ce58d9 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:09 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:09 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 1073741824 Sep 01 01:58:09 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73652ef4-809e-4a68-8076-20a9597585a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37aac33-f5a7-4aba-8c54-7a717778bc77', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:09 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf Sep 01 01:58:09 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9b5cf6-1682-4aed-822e-9a9d0ee053ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:09 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 (c37aac33-f5a7-4aba-8c54-7a717778bc77): created successfully Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9b5cf6-1682-4aed-822e-9a9d0ee053ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (a237fa8e-7e42-4b96-945a-2b37ba02d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8e44dc2f-9ece-4d57-a00f-b4c7c2671ca9 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created volume successfully. Sep 01 01:58:09 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-8fd1f3c5-aaf7-404a-b585-d584350722ae" returned: 0 in 0.377s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-quobyte-8fd1f3c5-aaf7-404a-b585-d584350722ae" released by "delete_volume" :: held 1.285s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:10 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (f055a221-f4a4-4216-8e82-d1e488b8df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b2a89f-790a-405d-95d0-f5f1be50b05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf" returned: 0 in 0.569s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Created reservations ['a006a8ce-51e6-4c1d-b166-4aeb75bcb386', '120232ed-ad2c-4511-9740-66ad9ec149ce', '9b57b6c5-b43d-4aa7-8866-60a796be3f69', '0ff4f470-ff51-4862-9e6b-99160f7e3fcb'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b2a89f-790a-405d-95d0-f5f1be50b05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-840937914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad04e1fb-f42b-4296-85ca-570ab89947d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:10Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170d6b76-e3b7-4b42-b2f2-67222d996b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170d6b76-e3b7-4b42-b2f2-67222d996b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60309298-0488-4863-bf85-f8baa4cd4098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60309298-0488-4863-bf85-f8baa4cd4098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad04e1fb-f42b-4296-85ca-570ab89947d2', 'volume_name': 'volume-ad04e1fb-f42b-4296-85ca-570ab89947d2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f6cb55-7bdc-44c4-a9cb-6a59bf7cef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f6cb55-7bdc-44c4-a9cb-6a59bf7cef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2ef49d-ab25-466a-b3b5-0b3106137ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume ad04e1fb-f42b-4296-85ca-570ab89947d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad04e1fb-f42b-4296-85ca-570ab89947d2', 'volume_size': 1} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c637d33-dd93-4c24-b7ab-508dc94c157a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:10 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:10 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:10 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 Sep 01 01:58:10 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:10 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 1073741824" returned: 0 in 0.883s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:10 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 Sep 01 01:58:10 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:10 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.541s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Deleted volume successfully. Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-34a50df9-6b6e-40a1-88f2-2b53623b11f3 tempest-VolumeDependencyTests-128704454 None] Lock "cinder-8fd1f3c5-aaf7-404a-b585-d584350722ae-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:10 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9" returned: 0 in 0.330s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.622s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1131730376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1704189c-038e-4c3c-98e1-14d8c374cd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:08Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Creating volume 1704189c-038e-4c3c-98e1-14d8c374cd47 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:10 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:10 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" returned: 0 in 0.777s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:10 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 1073741824 Sep 01 01:58:10 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbeb8383-14f7-4437-9f1d-7e57136367ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:11 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf Sep 01 01:58:11 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc82298c-bb57-4cf1-acf2-4f3f73bdd376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 (ea846e1b-e582-4d93-baf4-af4ec3ce58d9): created successfully Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc82298c-bb57-4cf1-acf2-4f3f73bdd376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (4757c254-15c7-4f7d-95ab-58518aa9ac5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a1fb98e5-bcb0-494b-8024-553ff1e25d5e tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created volume successfully. Sep 01 01:58:11 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf" returned: 0 in 0.543s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:11 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf Sep 01 01:58:11 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:11 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 1073741824" returned: 0 in 0.752s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:11 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 Sep 01 01:58:11 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:11 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93.fb7749c8-e05f-4960-a74c-6763597d22bf" returned: 0 in 0.367s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-fb7749c8-e05f-4960-a74c-6763597d22bf" released by "_delete_snapshot" :: held 2.517s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" released by "delete_snapshot" :: held 2.572s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Created reservations ['e629aad3-0b94-401b-b36d-7eada340fbad', '53b22f51-e542-4b54-a74f-aeaba18bbae9', '5ce4dc41-7713-4c6b-b0cf-056577f1a339', 'bf364b6c-aaf9-4e2e-a5fe-cf128c494bca'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:12 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47" returned: 0 in 0.365s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.984s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902735353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf78ecd-ae2c-41a2-bc30-92d973703f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:09Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Creating volume daf78ecd-ae2c-41a2-bc30-92d973703f42 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:12 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d28d17-e6d7-4552-bb5b-fee6b70f813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1704189c-038e-4c3c-98e1-14d8c374cd47', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5d254-da81-47e9-9d06-c104050b43ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:12 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 1073741824 Sep 01 01:58:12 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-99c8c736-4fa7-4069-8602-88b205e5c857 tempest-ProjectMemberTests-671459076 None] Lock "cinder-fb7749c8-e05f-4960-a74c-6763597d22bf-delete_snapshot" released by "delete_snapshot" :: held 2.860s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:12 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume volume-1704189c-038e-4c3c-98e1-14d8c374cd47 (1704189c-038e-4c3c-98e1-14d8c374cd47): created successfully Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5d254-da81-47e9-9d06-c104050b43ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (f1ae8a1b-5cbc-43a5-82db-f0f6c346f528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9bd2530c-7007-4806-96c2-0d53e01b2ade tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created volume successfully. Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Lock "cinder-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" acquired by "delete_volume" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:12 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 1073741824" returned: 0 in 0.690s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[498c49db-5fd5-4d37-a9df-d77b7c5486ce]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:12 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 Sep 01 01:58:12 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:13 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 Sep 01 01:58:13 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:13 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.171s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-840937914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad04e1fb-f42b-4296-85ca-570ab89947d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bc1bc996a0c40d4a58e5824fbed6c6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:10Z,use_quota=True,user_id='b9df4539fcb2440396608dc230afc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Creating volume ad04e1fb-f42b-4296-85ca-570ab89947d2 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:13 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:13 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" returned: 0 in 0.540s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:13 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 1073741824 Sep 01 01:58:13 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bca3378-d124-40cc-acec-ce462e1ce90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf78ecd-ae2c-41a2-bc30-92d973703f42', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:13 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93 Sep 01 01:58:13 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce1146e-641d-4724-9827-d0161025adcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:13 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 (daf78ecd-ae2c-41a2-bc30-92d973703f42): created successfully Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce1146e-641d-4724-9827-d0161025adcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (52162ed1-1a8b-4352-ac71-396566a4cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:13 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-abb77e1f-f155-4080-8b1a-dd3ed21398d1 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created volume successfully. Sep 01 01:58:13 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" returned: 0 in 0.400s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93" released by "delete_volume" :: held 1.051s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:13 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Created reservations ['b0271840-87a6-4b87-b7c6-2f0d56a00162', 'eb3c75fc-f14f-484c-bac6-235eeaa1d776', 'd13376f9-add2-4c4f-b85d-cc927839b9c7', 'aaeb9480-f506-4e08-8c71-2473efdb26f6'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:14 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:14 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:14 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 1073741824" returned: 0 in 0.739s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:14 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 Sep 01 01:58:14 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:14 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2" returned: 0 in 0.319s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2ef49d-ab25-466a-b3b5-0b3106137ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad04e1fb-f42b-4296-85ca-570ab89947d2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:14 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07182525-239a-41ae-a46f-0a83ae3909b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.462s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:14 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Volume volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 (ad04e1fb-f42b-4296-85ca-570ab89947d2): created successfully Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07182525-239a-41ae-a46f-0a83ae3909b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Flow 'volume_create_manager' (f055a221-f4a4-4216-8e82-d1e488b8df63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:58:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a63143ac-f5a9-4ef1-b263-a0b1e9889d09 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created volume successfully. Sep 01 01:58:14 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b25af2f-d91d-47b6-aa1f-a84e692d9c17 tempest-ProjectMemberTests-671459076 None] Lock "cinder-c7ffb55d-0f28-4e8d-959f-3e0e4a34db93-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-ad04e1fb-f42b-4296-85ca-570ab89947d2-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-ad04e1fb-f42b-4296-85ca-570ab89947d2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (ec0bc752-d33e-49db-8fd4-ed5d45ef2a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1194bf-a467-4039-a194-bc65d70f7f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1194bf-a467-4039-a194-bc65d70f7f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337716528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45c8b47-1b53-4d59-8bc0-52cdc275c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:16Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506bef84-62cf-4331-9d26-b54723bd5d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506bef84-62cf-4331-9d26-b54723bd5d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94b5338-603f-48c8-b188-9e070f7035c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94b5338-603f-48c8-b188-9e070f7035c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd45c8b47-1b53-4d59-8bc0-52cdc275c649', 'volume_name': 'volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a312bcff-e60b-48c5-a946-cfe2258370dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a312bcff-e60b-48c5-a946-cfe2258370dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d359045-b1d6-4063-96fb-0579382ec3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:15 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Volume d45c8b47-1b53-4d59-8bc0-52cdc275c649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649', 'volume_size': 1} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337716528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45c8b47-1b53-4d59-8bc0-52cdc275c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:16Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Creating volume d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:15 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:15 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 1073741824 Sep 01 01:58:15 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-quobyte-ad04e1fb-f42b-4296-85ca-570ab89947d2" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-ad04e1fb-f42b-4296-85ca-570ab89947d2" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e8b9da-f4a1-4e67-89dd-8f9d27c2feca]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:16 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 Sep 01 01:58:16 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:16 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 1073741824" returned: 0 in 0.628s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:16 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2" returned: 0 in 0.587s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:16 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2 Sep 01 01:58:16 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:16 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 Sep 01 01:58:16 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:16 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ad04e1fb-f42b-4296-85ca-570ab89947d2" returned: 0 in 0.352s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-ad04e1fb-f42b-4296-85ca-570ab89947d2" released by "delete_volume" :: held 1.001s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:16 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649" returned: 0 in 0.369s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d359045-b1d6-4063-96fb-0579382ec3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3825a17c-548e-4910-afb0-9144b8cb9d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:16 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created reservations ['50e83d6a-aad2-4698-b56e-f421f3b492c2', 'cf1674dd-70c9-4332-bedf-1c2ad247e0d0', '275f7622-b86b-4e3c-a2f0-d557267b82fe', 'ddfb20cc-6b8b-414f-bdd2-348861ee55ab'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:16 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Volume volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 (d45c8b47-1b53-4d59-8bc0-52cdc275c649): created successfully Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3825a17c-548e-4910-afb0-9144b8cb9d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (ec0bc752-d33e-49db-8fd4-ed5d45ef2a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6370f9ed-7345-4f18-9c88-bbd0a6d17636 tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:17 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:17 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:17 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:17 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Flow 'volume_create_manager' (94094d10-9c3c-4843-b0ea-a65e8a08d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa8a3e9-c60b-4b2d-aea1-434318515e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa8a3e9-c60b-4b2d-aea1-434318515e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b37723a-9f44-46e7-954c-1a343fafc584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea36b933c0d6404f998cfbd4a2500f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:17Z,use_quota=True,user_id='39937affbcf942f7a9af99114b6b5172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf25726-de85-4e76-bddb-62f9b3f0b0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf25726-de85-4e76-bddb-62f9b3f0b0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fcb9d3-f475-4c19-aa06-59970b94f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4fcb9d3-f475-4c19-aa06-59970b94f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b37723a-9f44-46e7-954c-1a343fafc584', 'volume_name': 'volume-2b37723a-9f44-46e7-954c-1a343fafc584', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807449c5-4de1-43a7-898a-33479a162d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807449c5-4de1-43a7-898a-33479a162d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcdb7f3-82ee-46a9-a586-43b9719816b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:17 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Volume 2b37723a-9f44-46e7-954c-1a343fafc584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b37723a-9f44-46e7-954c-1a343fafc584', 'volume_size': 1} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b37723a-9f44-46e7-954c-1a343fafc584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea36b933c0d6404f998cfbd4a2500f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:17Z,use_quota=True,user_id='39937affbcf942f7a9af99114b6b5172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Creating volume 2b37723a-9f44-46e7-954c-1a343fafc584 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:17 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:17 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.480s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Deleted volume successfully. Sep 01 01:58:17 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 1073741824 Sep 01 01:58:17 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e560a6ef-e1f4-478c-82ee-d1abf3e7966b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-ad04e1fb-f42b-4296-85ca-570ab89947d2-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:17 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.523s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:58:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:18 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 1073741824" returned: 0 in 0.607s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:18 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 Sep 01 01:58:18 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-daf78ecd-ae2c-41a2-bc30-92d973703f42-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-daf78ecd-ae2c-41a2-bc30-92d973703f42-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-quobyte-daf78ecd-ae2c-41a2-bc30-92d973703f42" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-daf78ecd-ae2c-41a2-bc30-92d973703f42" acquired by "delete_volume" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7643b49-f8d2-454f-b3ad-4e763dbdfdfc]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:18 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584" returned: 0 in 0.387s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.559s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bcdb7f3-82ee-46a9-a586-43b9719816b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b37723a-9f44-46e7-954c-1a343fafc584', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471d7291-ff74-44f1-a5f8-e7ded703df69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:18 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 Sep 01 01:58:18 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Creating offline snapshot 856045d7-3472-4750-b757-dd8ed6c6ff74 of volume d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:58:18 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Volume volume-2b37723a-9f44-46e7-954c-1a343fafc584 (2b37723a-9f44-46e7-954c-1a343fafc584): created successfully Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471d7291-ff74-44f1-a5f8-e7ded703df69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Flow 'volume_create_manager' (94094d10-9c3c-4843-b0ea-a65e8a08d415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cefd27-fe53-455c-9df0-c1232173097d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b471ba53-703f-4415-bc95-8a7766fbf696 tempest-CinderUnicodeTest-1709472330 None] Created volume successfully. Sep 01 01:58:18 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 Sep 01 01:58:18 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:18 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42" returned: 0 in 0.425s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:18 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42 Sep 01 01:58:18 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:19 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649" returned: 0 in 0.433s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:19 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 1G Sep 01 01:58:19 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:19 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-daf78ecd-ae2c-41a2-bc30-92d973703f42" returned: 0 in 0.275s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-daf78ecd-ae2c-41a2-bc30-92d973703f42" released by "delete_volume" :: held 0.759s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created reservations ['a4b50cf8-0941-4dba-9a88-3d9b48f2f71a', '4df2bccb-e488-4371-af54-5cacad3b6f9a', '5237f62f-f058-4490-9455-1991543a2f40', 'd4ec14a1-dbb3-4323-b8a4-a8463c6bff80'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:19 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:19 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-1704189c-038e-4c3c-98e1-14d8c374cd47-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-1704189c-038e-4c3c-98e1-14d8c374cd47-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-quobyte-1704189c-038e-4c3c-98e1-14d8c374cd47" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-1704189c-038e-4c3c-98e1-14d8c374cd47" acquired by "delete_volume" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:19 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 1G" returned: 0 in 0.653s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e6f89e-7052-417e-979e-b16076b87f22]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:19 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 Sep 01 01:58:19 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:19 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.444s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:19 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Deleted volume successfully. Sep 01 01:58:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-466dcdb2-877d-41a3-a509-730e73ac3cb4 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-daf78ecd-ae2c-41a2-bc30-92d973703f42-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:19 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 Sep 01 01:58:19 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:20 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74" returned: 0 in 0.472s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:20 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 is being set with open permissions: ugo+rw Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:20 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 Sep 01 01:58:20 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:20 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47" returned: 0 in 0.576s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:20 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47 Sep 01 01:58:20 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Flow 'volume_create_manager' (3ab0ae0a-c0ed-4d1b-b3d3-0653f7e4b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df5949a-c26b-469c-80f9-f62845aa5677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df5949a-c26b-469c-80f9-f62845aa5677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1805402226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1de8e56-692a-4fe6-90e1-b82bf73846ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea36b933c0d6404f998cfbd4a2500f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:20Z,use_quota=True,user_id='39937affbcf942f7a9af99114b6b5172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01855805-466f-4a07-b965-186e29ef6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01855805-466f-4a07-b965-186e29ef6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5e4110-1a06-4fc6-b43f-9fe85fa77202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5e4110-1a06-4fc6-b43f-9fe85fa77202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1de8e56-692a-4fe6-90e1-b82bf73846ec', 'volume_name': 'volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf11386-9617-450e-a146-2859a2b5746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf11386-9617-450e-a146-2859a2b5746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efae8c8d-d1d9-4a57-86f3-d5f8f6580463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:20 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Volume d1de8e56-692a-4fe6-90e1-b82bf73846ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec', 'volume_size': 1} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:20 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74" returned: 0 in 0.321s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:20 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.info Sep 01 01:58:20 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:20 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-1704189c-038e-4c3c-98e1-14d8c374cd47" returned: 0 in 0.344s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-1704189c-038e-4c3c-98e1-14d8c374cd47" released by "delete_volume" :: held 0.988s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created reservations ['6ad41234-ab9e-4dc6-ba77-48ceeb533836', 'd88dd954-50ca-4ab7-89b2-061dbcb058e1', '9f97bb32-2274-43e4-8f0c-016cfa611ee3', 'ade96101-8093-4d32-b3b6-6078b4c4527d'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:20 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.info" returned: 0 in 0.310s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:20 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.info is being set with open permissions: ugo+rw Sep 01 01:58:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:20 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:20 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:20 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.info Sep 01 01:58:20 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:21 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.289s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Deleted volume successfully. Sep 01 01:58:21 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3a69dd43-541c-49d8-a838-ffeac1ec9730 tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-1704189c-038e-4c3c-98e1-14d8c374cd47-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.info" returned: 0 in 0.382s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1805402226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1de8e56-692a-4fe6-90e1-b82bf73846ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea36b933c0d6404f998cfbd4a2500f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:20Z,use_quota=True,user_id='39937affbcf942f7a9af99114b6b5172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Creating volume d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:21 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec 1073741824 Sep 01 01:58:21 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:21 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a72bb315-e248-45a9-b9c4-85ae69f41364 tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:58:21 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec 1073741824" returned: 0 in 0.505s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec Sep 01 01:58:21 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-ea846e1b-e582-4d93-baf4-af4ec3ce58d9-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-ea846e1b-e582-4d93-baf4-af4ec3ce58d9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-quobyte-ea846e1b-e582-4d93-baf4-af4ec3ce58d9" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-ea846e1b-e582-4d93-baf4-af4ec3ce58d9" acquired by "delete_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca27b60-9a46-4035-913a-7647c7f13fa1]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:22 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-856045d7-3472-4750-b757-dd8ed6c6ff74-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:22 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 Sep 01 01:58:22 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Lock "cinder-856045d7-3472-4750-b757-dd8ed6c6ff74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-d45c8b47-1b53-4d59-8bc0-52cdc275c649" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efae8c8d-d1d9-4a57-86f3-d5f8f6580463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127b4bc0-1201-4307-a371-7715eb47ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:22 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Volume volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec (d1de8e56-692a-4fe6-90e1-b82bf73846ec): created successfully Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127b4bc0-1201-4307-a371-7715eb47ca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Flow 'volume_create_manager' (3ab0ae0a-c0ed-4d1b-b3d3-0653f7e4b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-d45c8b47-1b53-4d59-8bc0-52cdc275c649" acquired by "delete_snapshot" :: waited 0.092s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-856045d7-3472-4750-b757-dd8ed6c6ff74" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:22 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-be057eb5-86f3-440b-85aa-082e72f0acaa tempest-CinderUnicodeTest-1709472330 None] Created volume successfully. Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-856045d7-3472-4750-b757-dd8ed6c6ff74" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot 856045d7-3472-4750-b757-dd8ed6c6ff74 of volume d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7b014d-32b9-4821-8a52-48bc54276cde]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:22 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 Sep 01 01:58:22 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:22 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9" returned: 0 in 0.599s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:22 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9 Sep 01 01:58:22 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:23 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74" returned: 0 in 0.486s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[60af5b7c-776f-4b1a-8218-0d532e16bfe9]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:23 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea846e1b-e582-4d93-baf4-af4ec3ce58d9" returned: 0 in 0.418s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-ea846e1b-e582-4d93-baf4-af4ec3ce58d9" released by "delete_volume" :: held 1.075s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:23 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 Sep 01 01:58:23 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created reservations ['913e8e01-b898-4dd4-b852-f721ce771f88', '7cde029b-be83-4eac-a3a6-0a61862a82fa', '45222589-b0a1-4823-a152-5ec5b42bb18c', '44a2c4c8-6f1d-4244-add8-faca1be6e814'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:23 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:23 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:23 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649" returned: 0 in 0.605s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:23 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 Sep 01 01:58:23 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:23 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.386s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Deleted volume successfully. Sep 01 01:58:23 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-82176c8f-3e48-4628-8615-be0cb32362cd tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-ea846e1b-e582-4d93-baf4-af4ec3ce58d9-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Creating offline snapshot 28b1ac98-89c9-43bd-8ee0-15125f3025cc of volume d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6011d2e-232c-4486-9859-a9f1b3a882cb]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:24 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74" returned: 0 in 0.569s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:24 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74 Sep 01 01:58:24 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-c37aac33-f5a7-4aba-8c54-7a717778bc77-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-c37aac33-f5a7-4aba-8c54-7a717778bc77-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:24 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec Sep 01 01:58:24 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-quobyte-c37aac33-f5a7-4aba-8c54-7a717778bc77" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-c37aac33-f5a7-4aba-8c54-7a717778bc77" acquired by "delete_volume" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaea4c0-b228-4876-a881-48a913806703]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:24 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 Sep 01 01:58:24 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:24 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649.856045d7-3472-4750-b757-dd8ed6c6ff74" returned: 0 in 0.499s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-856045d7-3472-4750-b757-dd8ed6c6ff74" released by "_delete_snapshot" :: held 2.331s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-d45c8b47-1b53-4d59-8bc0-52cdc275c649" released by "delete_snapshot" :: held 2.382s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:24 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=279,cinder:SELECT=213,cinder:INSERT=76,cinder:DELETE=25 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec" returned: 0 in 0.603s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:24 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=211,cinder:UPDATE=291,cinder:DELETE=28,cinder:INSERT=70 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Created reservations ['a2b18cce-8c2e-474b-a38c-6cbe26317c14', 'e435b16d-0566-497d-a854-b990a1f52a13', 'bfb4b6cb-abda-4d2e-9bee-9778fb1df350', '4ff745f1-7cb4-4f50-8ede-b20f4c51ead1'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:24 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc 1G Sep 01 01:58:24 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b46a8305-8b4a-4de3-959a-bb5cff15d50d tempest-ProjectMemberTests-671459076 None] Lock "cinder-856045d7-3472-4750-b757-dd8ed6c6ff74-delete_snapshot" released by "delete_snapshot" :: held 2.706s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:25 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77" returned: 0 in 0.563s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:25 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77 Sep 01 01:58:25 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:25 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-c37aac33-f5a7-4aba-8c54-7a717778bc77" returned: 0 in 0.328s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:25 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc 1G" returned: 0 in 0.605s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-c37aac33-f5a7-4aba-8c54-7a717778bc77" released by "delete_volume" :: held 0.978s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:25 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc Sep 01 01:58:25 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created reservations ['f7cba669-dce1-48cb-9dfb-b021a593efcd', 'f188e171-e135-4e8e-a3d3-34f39266c46f', '71101fbd-4acd-47b9-b51c-8dd5333b9faa', '4f2015a4-5053-453d-98a1-97a448d3aaf0'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:25 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:25 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-d45c8b47-1b53-4d59-8bc0-52cdc275c649-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-d45c8b47-1b53-4d59-8bc0-52cdc275c649-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-d45c8b47-1b53-4d59-8bc0-52cdc275c649" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-d45c8b47-1b53-4d59-8bc0-52cdc275c649" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d0f283-1ba0-431e-8b3d-b28fbf38793e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:25 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.319s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:25 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Deleted volume successfully. Sep 01 01:58:25 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc" returned: 0 in 0.525s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:25 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc is being set with open permissions: ugo+rw Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:25 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 Sep 01 01:58:25 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c1f78da7-869b-482c-92c7-788eabb1106d tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-c37aac33-f5a7-4aba-8c54-7a717778bc77-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:25 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:26 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc Sep 01 01:58:26 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:26 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:26 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649" returned: 0 in 0.447s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:26 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649 Sep 01 01:58:26 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:26 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.info Sep 01 01:58:26 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:26 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d45c8b47-1b53-4d59-8bc0-52cdc275c649" returned: 0 in 0.261s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-d45c8b47-1b53-4d59-8bc0-52cdc275c649" released by "delete_volume" :: held 0.802s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Created reservations ['a1cb3b0e-853d-4a80-b40e-3d4cae315b50', 'ff239cb4-75bc-4bc5-ae47-567751e8bd51', '080752ef-385d-467e-8b42-407fdb6a9cd7', '168bdf23-d872-4cb7-98e3-ccfc5da9a306'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:26 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.info" returned: 0 in 0.323s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:26 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.info is being set with open permissions: ugo+rw Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:26 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.info Sep 01 01:58:26 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-7967d251-4d09-42a0-96c4-66dd6a0dd86a-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-7967d251-4d09-42a0-96c4-66dd6a0dd86a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:26 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:26 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "cinder-quobyte-7967d251-4d09-42a0-96c4-66dd6a0dd86a" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:26 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-7967d251-4d09-42a0-96c4-66dd6a0dd86a" acquired by "delete_volume" :: waited 0.039s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f462a6-1cf7-49f7-bfbe-adfd16ea4f2b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:27 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.info" returned: 0 in 0.467s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:27 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a Sep 01 01:58:27 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-230d6841-8e01-472f-affc-e48854f9642f tempest-CinderUnicodeTest-1709472330 None] Create snapshot completed successfully Sep 01 01:58:27 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.517s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "cinder-28b1ac98-89c9-43bd-8ee0-15125f3025cc-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-28b1ac98-89c9-43bd-8ee0-15125f3025cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "cinder-quobyte-d1de8e56-692a-4fe6-90e1-b82bf73846ec" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-517b55da-a818-455d-9ae4-65bf0937e5a2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-d45c8b47-1b53-4d59-8bc0-52cdc275c649-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-d1de8e56-692a-4fe6-90e1-b82bf73846ec" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "cinder-quobyte-28b1ac98-89c9-43bd-8ee0-15125f3025cc" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-28b1ac98-89c9-43bd-8ee0-15125f3025cc" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Deleting offline snapshot 28b1ac98-89c9-43bd-8ee0-15125f3025cc of volume d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] snapshot_file for this snap is: volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96dd7a8-83ca-47f7-8259-2022b683e353]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:27 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a" returned: 0 in 0.600s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:27 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a Sep 01 01:58:27 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:27 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc Sep 01 01:58:27 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (3fb3c308-af27-437b-bb9d-d9b30356e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc277d4e-5f1c-4104-b0ad-25eb2713477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc277d4e-5f1c-4104-b0ad-25eb2713477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-336308085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:28Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ea058c-4acd-4a01-aefa-be78a7a391fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ea058c-4acd-4a01-aefa-be78a7a391fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc3339d-d42e-4dc0-9fa6-aaa9202ddf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc3339d-d42e-4dc0-9fa6-aaa9202ddf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2', 'volume_name': 'volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa120dc-b016-45f2-9f54-142d0c38260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa120dc-b016-45f2-9f54-142d0c38260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46390571-cc21-41b7-920b-fd91d3860c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:27 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Volume f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2', 'volume_size': 1} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-336308085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:28Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Creating volume f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:27 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:27 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:27 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 1073741824 Sep 01 01:58:27 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:28 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7967d251-4d09-42a0-96c4-66dd6a0dd86a" returned: 0 in 0.404s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-quobyte-7967d251-4d09-42a0-96c4-66dd6a0dd86a" released by "delete_volume" :: held 1.103s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Created reservations ['60b7563a-1c29-4ac0-84c9-ca6874627688', '45db53d7-7c11-4c43-b72d-691ba14c4c3c', 'b46827d2-f337-417b-b735-3517f2eace39', '5b0e0888-2206-4750-9fea-292900c32124'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:28 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc" returned: 0 in 0.529s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b110f2-adbe-4077-a574-4c719cff5a84]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:28 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec Sep 01 01:58:28 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:28 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:28 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:28 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 1073741824" returned: 0 in 0.592s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:28 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 Sep 01 01:58:28 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:28 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.384s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:28 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec" returned: 0 in 0.500s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:28 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Deleted volume successfully. Sep 01 01:58:28 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc Sep 01 01:58:28 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-190a7a6e-5c42-44ec-a4e8-b869e74f035b tempest-CreateVolumesFromSourceVolumeTest-688519285 None] Lock "cinder-7967d251-4d09-42a0-96c4-66dd6a0dd86a-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Flow 'volume_create_manager' (3dafdd8b-beaa-4388-930a-140fa1d682fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a93d9b3-9c5f-4c3f-aae2-4e59a567dcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a93d9b3-9c5f-4c3f-aae2-4e59a567dcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1062793177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dd1f87-016c-4c0e-a105-882df6a73e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8475d3fa694dae9be5d4939abe076f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:29Z,use_quota=True,user_id='052e1c423f104032b3cdbf4a2a9e28f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a1bf2a-6114-4540-a778-4d5f9249f842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a1bf2a-6114-4540-a778-4d5f9249f842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c02b8b5-565f-46da-8e3a-c93689cf3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c02b8b5-565f-46da-8e3a-c93689cf3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dd1f87-016c-4c0e-a105-882df6a73e57', 'volume_name': 'volume-e2dd1f87-016c-4c0e-a105-882df6a73e57', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8222c0-afd7-4942-b169-bf293c8c2e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8222c0-afd7-4942-b169-bf293c8c2e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f54e21-400c-45b8-91e4-a27d83f3cddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Volume e2dd1f87-016c-4c0e-a105-882df6a73e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dd1f87-016c-4c0e-a105-882df6a73e57', 'volume_size': 1} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:28 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" returned: 0 in 0.345s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1062793177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dd1f87-016c-4c0e-a105-882df6a73e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8475d3fa694dae9be5d4939abe076f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:29Z,use_quota=True,user_id='052e1c423f104032b3cdbf4a2a9e28f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Creating volume e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:28 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46390571-cc21-41b7-920b-fd91d3860c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:28 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 1073741824 Sep 01 01:58:28 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323fe505-17db-4c13-b927-1a844ad282f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:28 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Volume volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 (f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2): created successfully Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323fe505-17db-4c13-b927-1a844ad282f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:28 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (3fb3c308-af27-437b-bb9d-d9b30356e49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:28 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0ed63b5d-c931-4ca0-a36d-be80d950f064 tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:58:29 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc" returned: 0 in 0.415s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:29 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc Sep 01 01:58:29 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:29 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec.28b1ac98-89c9-43bd-8ee0-15125f3025cc" returned: 0 in 0.298s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:29 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 1073741824" returned: 0 in 0.488s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-28b1ac98-89c9-43bd-8ee0-15125f3025cc" released by "_delete_snapshot" :: held 1.888s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-d1de8e56-692a-4fe6-90e1-b82bf73846ec" released by "delete_snapshot" :: held 1.935s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:29 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 Sep 01 01:58:29 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Created reservations ['7087b106-a25c-4c8d-9e17-bd1801a43c6e', 'e6984a92-4997-41f7-bd3d-8122d9d2da5f', '8597c400-9bc4-4222-8f26-bc588d69fe3e', '46169af9-c295-40e1-801c-db95caa010a2'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Delete snapshot completed successfully. Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f9e0ce17-ad10-4f18-bcc2-10ffe0e8a63d tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-28b1ac98-89c9-43bd-8ee0-15125f3025cc-delete_snapshot" released by "delete_snapshot" :: held 2.226s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:29 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57" returned: 0 in 0.347s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f54e21-400c-45b8-91e4-a27d83f3cddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dd1f87-016c-4c0e-a105-882df6a73e57', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8744b2-635e-4dea-99ba-44e4566fbbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:29 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Volume volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 (e2dd1f87-016c-4c0e-a105-882df6a73e57): created successfully Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8744b2-635e-4dea-99ba-44e4566fbbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:29 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Flow 'volume_create_manager' (3dafdd8b-beaa-4388-930a-140fa1d682fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-18f06f80-5a8e-46bb-983b-66140c15c3da tempest-SnapshotDependencyTests-1986129716 None] Created volume successfully. Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Creating offline snapshot 8b45b575-97e0-411a-b8ab-8d5ca53275a9 of volume f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c553ee-3a3c-4265-8298-50cd2d896c77]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:30 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 Sep 01 01:58:30 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:30 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" returned: 0 in 0.380s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:30 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 1G Sep 01 01:58:30 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "cinder-d1de8e56-692a-4fe6-90e1-b82bf73846ec-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-d1de8e56-692a-4fe6-90e1-b82bf73846ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "cinder-quobyte-d1de8e56-692a-4fe6-90e1-b82bf73846ec" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-d1de8e56-692a-4fe6-90e1-b82bf73846ec" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5797fb3-d331-460f-bbdb-a1889c597295]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec Sep 01 01:58:31 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 1G" returned: 0 in 0.614s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 Sep 01 01:58:31 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:31 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec" returned: 0 in 0.433s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec Sep 01 01:58:31 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9" returned: 0 in 0.357s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 is being set with open permissions: ugo+rw Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 Sep 01 01:58:31 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-d1de8e56-692a-4fe6-90e1-b82bf73846ec" returned: 0 in 0.287s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-d1de8e56-692a-4fe6-90e1-b82bf73846ec" released by "delete_volume" :: held 0.792s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Created reservations ['ec518e8f-3d03-44c0-bf95-2e0264b2a827', '07bb0598-fa28-4757-bc52-937d98203165', 'b665e0c8-3d85-453a-89f3-bb3609d91118', '411e443c-171a-4bbe-96ab-b2507473d49e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:31 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.info Sep 01 01:58:31 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:31 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:31 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "cinder-2b37723a-9f44-46e7-954c-1a343fafc584-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-2b37723a-9f44-46e7-954c-1a343fafc584-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "cinder-quobyte-2b37723a-9f44-46e7-954c-1a343fafc584" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:32 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.info" returned: 0 in 0.332s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:32 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.info is being set with open permissions: ugo+rw Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-2b37723a-9f44-46e7-954c-1a343fafc584" acquired by "delete_volume" :: waited 0.044s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:32 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.info Sep 01 01:58:32 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29bac98-fe4e-4e85-9386-cdb260123b4c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:32 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.363s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Deleted volume successfully. Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-ba0ce5f9-19ea-4f50-9cf9-4d4eaa5b329b tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-d1de8e56-692a-4fe6-90e1-b82bf73846ec-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:32 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 Sep 01 01:58:32 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:32 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.info" returned: 0 in 0.300s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.180s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Creating offline snapshot a3a3eb94-6daf-4335-b40d-1109c77ddf84 of volume e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:58:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c23bcb11-383b-451c-9d24-b231ef029f11 tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dbd4a4-9475-4e31-99d3-81716d308b3d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:32 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584" returned: 0 in 0.455s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:32 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 Sep 01 01:58:32 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:32 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584 Sep 01 01:58:32 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:32 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57" returned: 0 in 0.445s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:32 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-2b37723a-9f44-46e7-954c-1a343fafc584" returned: 0 in 0.324s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:32 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 1G Sep 01 01:58:32 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-quobyte-2b37723a-9f44-46e7-954c-1a343fafc584" released by "delete_volume" :: held 0.836s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:32 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Created reservations ['9c68e8e9-f1b5-4e0f-93f2-47de57ccfd93', 'f9b7e2fe-e8de-41a1-81d4-1b0b08d3dba2', 'fa2ed936-098d-49bd-bc9b-ff811402e53e', '0072bafb-8d56-4acc-9017-fda582efbc19'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:33 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:33 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-8b45b575-97e0-411a-b8ab-8d5ca53275a9-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Lock "cinder-8b45b575-97e0-411a-b8ab-8d5ca53275a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-8b45b575-97e0-411a-b8ab-8d5ca53275a9" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-8b45b575-97e0-411a-b8ab-8d5ca53275a9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot 8b45b575-97e0-411a-b8ab-8d5ca53275a9 of volume f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b29493-ba69-4026-8a8b-7047ccb1f95e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:33 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.437s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:33 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 1G" returned: 0 in 0.670s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Deleted volume successfully. Sep 01 01:58:33 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 Sep 01 01:58:33 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:33 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 Sep 01 01:58:33 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e5a0490b-eb82-40ea-89d7-8d33aa589827 tempest-CinderUnicodeTest-1709472330 None] Lock "cinder-2b37723a-9f44-46e7-954c-1a343fafc584-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:33 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9" returned: 0 in 0.465s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:33 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84" returned: 0 in 0.391s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:33 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 is being set with open permissions: ugo+rw Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e412cc69-f740-4483-ba5a-fc7d9b08bd21]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:33 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 Sep 01 01:58:33 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:34 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 Sep 01 01:58:34 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:34 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84" returned: 0 in 0.345s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:34 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.info Sep 01 01:58:34 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:34 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" returned: 0 in 0.504s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:34 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 Sep 01 01:58:34 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:34 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.info" returned: 0 in 0.361s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:34 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.info is being set with open permissions: ugo+rw Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:34 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.info Sep 01 01:58:34 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:34 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9" returned: 0 in 0.482s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:34 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9 Sep 01 01:58:34 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:35 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.info" returned: 0 in 0.312s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6a6c27c9-7397-49f9-9131-aff335c2e65e tempest-SnapshotDependencyTests-1986129716 None] Create snapshot completed successfully Sep 01 01:58:35 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2.8b45b575-97e0-411a-b8ab-8d5ca53275a9" returned: 0 in 0.301s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-8b45b575-97e0-411a-b8ab-8d5ca53275a9" released by "_delete_snapshot" :: held 1.898s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" released by "delete_snapshot" :: held 1.929s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Created reservations ['76f8a9ec-199c-46c9-b9b9-461d3859dbed', '98c6aa64-276e-49d5-91ce-78bac117481a', '4c3f9ddd-b475-469e-acdf-8a7c987fc6b6', '5335df10-0a80-4995-a489-c0c837c119f7'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8fe659bc-df7d-4dbe-a27b-937ddc0ca7b1 tempest-ProjectMemberTests-671459076 None] Lock "cinder-8b45b575-97e0-411a-b8ab-8d5ca53275a9-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Lock "cinder-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[38057208-f14f-4c27-b340-6e2d1124cc49]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:35 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 Sep 01 01:58:35 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Flow 'volume_create_manager' (64efd4ff-0e7d-4d37-8035-77b3986c013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b47361-e51f-49fe-8230-3659bf7f50e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b47361-e51f-49fe-8230-3659bf7f50e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0266a9c1-6ccd-48e2-91d5-b482c13af1a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e6c6ba99b74a00ad6515965e962dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:36Z,use_quota=True,user_id='a93a855e150f45df9df98840844feeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d456b0a-dcaf-4e9d-b2b4-b17cf8f4308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d456b0a-dcaf-4e9d-b2b4-b17cf8f4308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c7a09f-7653-436a-b737-08d902500025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.image.glance [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Creating Keystone auth plugin from conf {{(pid=87212) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 01:58:36 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" returned: 0 in 0.539s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:36 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2 Sep 01 01:58:36 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Flow 'volume_create_manager' (8204c198-e15e-4d4d-9bf7-9d7be80b35d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80915ac1-dcac-4f59-9122-0735e5855bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80915ac1-dcac-4f59-9122-0735e5855bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd7863e-9567-441c-86d2-63606fa45690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8475d3fa694dae9be5d4939abe076f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3a3eb94-6daf-4335-b40d-1109c77ddf84,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:36Z,use_quota=True,user_id='052e1c423f104032b3cdbf4a2a9e28f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71ebe59-a66e-4ad7-979b-8d88952c95e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71ebe59-a66e-4ad7-979b-8d88952c95e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504a9a22-a7f4-41cc-a4f7-ff0106347406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504a9a22-a7f4-41cc-a4f7-ff0106347406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7dd7863e-9567-441c-86d2-63606fa45690', 'volume_name': 'volume-7dd7863e-9567-441c-86d2-63606fa45690', 'volume_size': 1, 'snapshot_id': 'a3a3eb94-6daf-4335-b40d-1109c77ddf84'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b0957c-31e9-4be7-b8fd-4b0cf895ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b0957c-31e9-4be7-b8fd-4b0cf895ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4cb8d2-1571-4536-91fe-7f78edb6491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Volume 7dd7863e-9567-441c-86d2-63606fa45690: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7dd7863e-9567-441c-86d2-63606fa45690', 'volume_size': 1, 'snapshot_id': 'a3a3eb94-6daf-4335-b40d-1109c77ddf84'} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-quobyte-a3a3eb94-6daf-4335-b40d-1109c77ddf84-7dd7863e-9567-441c-86d2-63606fa45690" by "_create_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:36 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c7a09f-7653-436a-b737-08d902500025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0266a9c1-6ccd-48e2-91d5-b482c13af1a3', 'volume_name': 'volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3', 'volume_size': 1, 'image_id': '6481d5af-e702-4018-b208-43da20b1e2f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6481d5af-e702-4018-b208-43da20b1e2f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28d0431870327cb3a899fe79e3cb730b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62e6c6ba99b74a00ad6515965e962dd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c80e0298fb9d6fff2a2e0c58fbb15c0a87b771f0e4c1b4f762ba61950d84e0ad0531f2d99e6d2f05dcda6a0297fe0ab04f461af399af5197fa6cfa6a45da6289', 'id': '6481d5af-e702-4018-b208-43da20b1e2f6', 'created_at': datetime.datetime(2026, 8, 31, 23, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6481d5af-e702-4018-b208-43da20b1e2f6/file', 'properties': {}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf960b41-f7d2-4d21-b699-c47b884c4f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf960b41-f7d2-4d21-b699-c47b884c4f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6618fc2-29b2-42b3-a11a-d2122a573d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Volume 0266a9c1-6ccd-48e2-91d5-b482c13af1a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3', 'volume_size': 1, 'image_id': '6481d5af-e702-4018-b208-43da20b1e2f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6481d5af-e702-4018-b208-43da20b1e2f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28d0431870327cb3a899fe79e3cb730b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62e6c6ba99b74a00ad6515965e962dd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c80e0298fb9d6fff2a2e0c58fbb15c0a87b771f0e4c1b4f762ba61950d84e0ad0531f2d99e6d2f05dcda6a0297fe0ab04f461af399af5197fa6cfa6a45da6289', 'id': '6481d5af-e702-4018-b208-43da20b1e2f6', 'created_at': datetime.datetime(2026, 8, 31, 23, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6481d5af-e702-4018-b208-43da20b1e2f6/file', 'properties': {}}, 'image_service': } Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Trying to clone 0266a9c1-6ccd-48e2-91d5-b482c13af1a3 from image 6481d5af-e702-4018-b208-43da20b1e2f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6481d5af-e702-4018-b208-43da20b1e2f6', 'metadata': {}}]). {{(pid=87212) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-a3a3eb94-6daf-4335-b40d-1109c77ddf84-7dd7863e-9567-441c-86d2-63606fa45690" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Creating volume 7dd7863e-9567-441c-86d2-63606fa45690 from snapshot a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-quobyte-7dd7863e-9567-441c-86d2-63606fa45690" by "_copy_volume_from_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" returned: 0 in 0.408s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2" released by "delete_volume" :: held 1.081s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-7dd7863e-9567-441c-86d2-63606fa45690" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] snapshot: a3a3eb94-6daf-4335-b40d-1109c77ddf84, volume: 7dd7863e-9567-441c-86d2-63606fa45690, {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[41798319-7283-41d8-87a0-75a9eea12c99]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 01:58:36 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Image download 0.00 MB at 0.00 MB/s Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Created reservations ['766eb1bc-4400-458f-88bf-c09eaa1cdc9b', '74cb04ef-172f-4ce1-a863-f2513a65e082', '73face44-66c1-412c-9705-63b303471780', '66255f7c-3c95-49ca-876f-6056b235862c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4932cd9-bee4-4040-a3d0-3568959a04e6]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:37 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 Sep 01 01:58:37 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:37 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:37 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD Sep 01 01:58:37 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84" returned: 0 in 0.477s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2dd1f87-016c-4c0e-a105-882df6a73e57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3438a3-7c2e-496d-89b5-775492c62d3f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:37 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:37 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.352s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:37 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b6ac2803-a8a4-4767-a2e5-8b88f350d1a6 tempest-ProjectMemberTests-671459076 None] Lock "cinder-f6ce9d15-0ae4-4877-9c6e-d245b2d1d0e2-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:37 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 Sep 01 01:58:37 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD Sep 01 01:58:37 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Temporary image 6481d5af-e702-4018-b208-43da20b1e2f6 is fetched for user a93a855e150f45df9df98840844feeb9. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 01:58:37 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Creating direct copy from snapshot {{(pid=87212) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG cinder.utils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Path /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 not found in is_blk_device check {{(pid=87212) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:37 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 Sep 01 01:58:37 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d913b-d830-42a3-9336-dbe1eda91e4d]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:37 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD Sep 01 01:58:37 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:38 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:38 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD Sep 01 01:58:38 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (df705eee-dc0b-45fb-a1b7-7eb7fef3137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95aced4-d85a-4ab8-b951-34e30cbe344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95aced4-d85a-4ab8-b951-34e30cbe344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316466941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:39Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baaefa0-fedd-4ff8-8be4-d371872190a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baaefa0-fedd-4ff8-8be4-d371872190a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a82621-fd9e-4079-a1aa-115526925170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a82621-fd9e-4079-a1aa-115526925170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8', 'volume_name': 'volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab23af6-1831-44bc-a434-be19d5a8412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab23af6-1831-44bc-a434-be19d5a8412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d624de-17c5-4371-92de-2f3f03c98ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:38 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Volume 46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8', 'volume_size': 1} Sep 01 01:58:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:39 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD" returned: 1 in 0.942s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:58:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690" returned: 0 in 5.042s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:42 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Image conversion details: src /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:58:42 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Converted 1024.00 MB image at 203.05 MB/s Sep 01 01:58:42 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 is being set with open permissions: ugo+rw Sep 01 01:58:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:42 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 Sep 01 01:58:42 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:43 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690" returned: 0 in 0.254s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-7dd7863e-9567-441c-86d2-63606fa45690" released by "_copy_volume_from_snapshot" :: held 6.327s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-a3a3eb94-6daf-4335-b40d-1109c77ddf84-7dd7863e-9567-441c-86d2-63606fa45690" released by "_create_volume_from_snapshot" :: held 6.430s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.484s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.277s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316466941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:39Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Creating volume 46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:43 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:43 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 1073741824 Sep 01 01:58:43 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4cb8d2-1571-4536-91fe-7f78edb6491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd7863e-9567-441c-86d2-63606fa45690', 'volume_size': 1, 'snapshot_id': 'a3a3eb94-6daf-4335-b40d-1109c77ddf84'}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45bd31b-f735-4a82-ba91-817dff24068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Volume volume-7dd7863e-9567-441c-86d2-63606fa45690 (7dd7863e-9567-441c-86d2-63606fa45690): created successfully Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45bd31b-f735-4a82-ba91-817dff24068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Flow 'volume_create_manager' (8204c198-e15e-4d4d-9bf7-9d7be80b35d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7654fbc2-7ed4-4cb1-b917-326bcdead3a9 tempest-SnapshotDependencyTests-1986129716 None] Created volume successfully. Sep 01 01:58:43 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 1073741824" returned: 0 in 0.434s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:43 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 Sep 01 01:58:43 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:43 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" returned: 0 in 0.236s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.712s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0266a9c1-6ccd-48e2-91d5-b482c13af1a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e6c6ba99b74a00ad6515965e962dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:36Z,use_quota=True,user_id='a93a855e150f45df9df98840844feeb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Creating volume 0266a9c1-6ccd-48e2-91d5-b482c13af1a3 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:43 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d624de-17c5-4371-92de-2f3f03c98ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:43 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 1073741824 Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac69800-aafb-432d-b36d-188bcdca9c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:43 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:43 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Volume volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 (46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8): created successfully Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac69800-aafb-432d-b36d-188bcdca9c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:43 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (df705eee-dc0b-45fb-a1b7-7eb7fef3137b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:43 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-494d09b5-4404-4c72-ab9b-6b20af540ed6 tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-a3a3eb94-6daf-4335-b40d-1109c77ddf84-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:44 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 1073741824" returned: 0 in 0.493s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-a3a3eb94-6daf-4335-b40d-1109c77ddf84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-quobyte-e2dd1f87-016c-4c0e-a105-882df6a73e57" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-e2dd1f87-016c-4c0e-a105-882df6a73e57" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-quobyte-a3a3eb94-6daf-4335-b40d-1109c77ddf84" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-a3a3eb94-6daf-4335-b40d-1109c77ddf84" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Deleting offline snapshot a3a3eb94-6daf-4335-b40d-1109c77ddf84 of volume e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:44 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 Sep 01 01:58:44 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] snapshot_file for this snap is: volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7537a4a-4f42-44e7-9745-14100f2cb68e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:44 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 Sep 01 01:58:44 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:44 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Attempting download of 6481d5af-e702-4018-b208-43da20b1e2f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/6481d5af-e702-4018-b208-43da20b1e2f6', 'metadata': {}}])) to volume 0266a9c1-6ccd-48e2-91d5-b482c13af1a3. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b29ad51-fdf8-4dc2-961e-a7823954a62e]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6481d5af-e702-4018-b208-43da20b1e2f6_t9_0ikt_ {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:44 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84" returned: 0 in 0.424s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2dd1f87-016c-4c0e-a105-882df6a73e57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:44 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6481d5af-e702-4018-b208-43da20b1e2f6_t9_0ikt_ Sep 01 01:58:44 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[591db066-db08-415b-9286-918774e674a6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:45 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 Sep 01 01:58:45 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:45 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6481d5af-e702-4018-b208-43da20b1e2f6_t9_0ikt_" returned: 0 in 0.393s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6481d5af-e702-4018-b208-43da20b1e2f6_t9_0ikt_ {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:45 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6481d5af-e702-4018-b208-43da20b1e2f6_t9_0ikt_ Sep 01 01:58:45 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Creating offline snapshot 56a8ab2b-3367-434a-bc07-011be790798a of volume 46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ccbf1d-43ac-42e9-831d-cc25db137649]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:45 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 Sep 01 01:58:45 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:45 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57" returned: 0 in 0.688s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:45 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6481d5af-e702-4018-b208-43da20b1e2f6_t9_0ikt_" returned: 1 in 0.464s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6481d5af-e702-4018-b208-43da20b1e2f6_t9_0ikt_' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caed95e-8fdb-480b-8806-0a99f5a41641]: (4, 'raw') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:45 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 Sep 01 01:58:45 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:45 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD Sep 01 01:58:45 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:45 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" returned: 0 in 0.471s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:45 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a 1G Sep 01 01:58:45 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:46 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84" returned: 0 in 0.440s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:46 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84 Sep 01 01:58:46 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:46 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:46 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD Sep 01 01:58:46 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:46 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a 1G" returned: 0 in 0.497s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:46 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57.a3a3eb94-6daf-4335-b40d-1109c77ddf84" returned: 0 in 0.297s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:46 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a Sep 01 01:58:46 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-a3a3eb94-6daf-4335-b40d-1109c77ddf84" released by "_delete_snapshot" :: held 1.976s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-e2dd1f87-016c-4c0e-a105-882df6a73e57" released by "delete_snapshot" :: held 2.023s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Created reservations ['9478ba46-d6e5-46e4-a427-a9a23e69d919', 'ccc84ec6-a40e-42ef-bddc-05b79e7c7f5c', '0117b950-d234-49f8-80d8-af547ad118d3', 'ce837c04-ea32-419a-aada-e0949ee46cec'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:46 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] 6481d5af-e702-4018-b208-43da20b1e2f6 was raw, converting to qcow2 {{(pid=87212) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:46 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 Sep 01 01:58:46 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:46 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Delete snapshot completed successfully. Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-c4fd3b5d-61d3-4269-b593-c8b0c29dbc2e tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-a3a3eb94-6daf-4335-b40d-1109c77ddf84-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:46 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a" returned: 0 in 0.330s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:46 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a is being set with open permissions: ugo+rw Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:46 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a Sep 01 01:58:46 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:46 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:47 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3" returned: 0 in 0.449s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6481d5af-e702-4018-b208-43da20b1e2f6_fpd21diqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 {{(pid=87212) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 01:58:47 devstack cinder-volume[87212]: INFO cinder.image.image_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:47 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.info Sep 01 01:58:47 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:47 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 1G Sep 01 01:58:47 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:47 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.info" returned: 0 in 0.259s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:47 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.info is being set with open permissions: ugo+rw Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:47 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.info Sep 01 01:58:47 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:47 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 1G" returned: 0 in 0.322s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Downloaded image 6481d5af-e702-4018-b208-43da20b1e2f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/6481d5af-e702-4018-b208-43da20b1e2f6', 'metadata': {}}])) to volume 0266a9c1-6ccd-48e2-91d5-b482c13af1a3 successfully. {{(pid=87212) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.image.image_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Temporary image 6481d5af-e702-4018-b208-43da20b1e2f6 for user a93a855e150f45df9df98840844feeb9 is deleted. {{(pid=87212) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.volume_utils [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Marking volume 0266a9c1-6ccd-48e2-91d5-b482c13af1a3 as bootable. {{(pid=87212) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Copying metadata from image 6481d5af-e702-4018-b208-43da20b1e2f6 to 0266a9c1-6ccd-48e2-91d5-b482c13af1a3. {{(pid=87212) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Creating volume glance metadata for volume 0266a9c1-6ccd-48e2-91d5-b482c13af1a3 backed by image 6481d5af-e702-4018-b208-43da20b1e2f6 with: {'image_id': '6481d5af-e702-4018-b208-43da20b1e2f6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '28d0431870327cb3a899fe79e3cb730b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87212) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6618fc2-29b2-42b3-a11a-d2122a573d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3', 'volume_size': 1, 'image_id': '6481d5af-e702-4018-b208-43da20b1e2f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6481d5af-e702-4018-b208-43da20b1e2f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28d0431870327cb3a899fe79e3cb730b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '62e6c6ba99b74a00ad6515965e962dd7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c80e0298fb9d6fff2a2e0c58fbb15c0a87b771f0e4c1b4f762ba61950d84e0ad0531f2d99e6d2f05dcda6a0297fe0ab04f461af399af5197fa6cfa6a45da6289', 'id': '6481d5af-e702-4018-b208-43da20b1e2f6', 'created_at': datetime.datetime(2026, 8, 31, 23, 58, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 58, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6481d5af-e702-4018-b208-43da20b1e2f6/file', 'properties': {}}, 'image_service': }' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317b55be-f5e7-425e-b51e-be4f5b4a8b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:47 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Volume volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 (0266a9c1-6ccd-48e2-91d5-b482c13af1a3): created successfully Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317b55be-f5e7-425e-b51e-be4f5b4a8b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Flow 'volume_create_manager' (64efd4ff-0e7d-4d37-8035-77b3986c013d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-64bee1b8-50ba-42c9-be41-e318f30f20d3 tempest-VolumeImageDependencyTests-1478761293 None] Created volume successfully. Sep 01 01:58:47 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.info" returned: 0 in 0.265s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4228ece9-e2b2-43a3-88d8-2f7626518945 tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-e2dd1f87-016c-4c0e-a105-882df6a73e57-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-e2dd1f87-016c-4c0e-a105-882df6a73e57-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-quobyte-e2dd1f87-016c-4c0e-a105-882df6a73e57" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-e2dd1f87-016c-4c0e-a105-882df6a73e57" acquired by "delete_volume" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30fb58-04a8-4da6-a099-350fdfad3dfd]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:47 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 Sep 01 01:58:47 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:48 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57" returned: 0 in 0.367s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:48 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57 Sep 01 01:58:48 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Acquiring lock "cinder-0266a9c1-6ccd-48e2-91d5-b482c13af1a3-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Lock "cinder-0266a9c1-6ccd-48e2-91d5-b482c13af1a3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Acquiring lock "cinder-quobyte-0266a9c1-6ccd-48e2-91d5-b482c13af1a3" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Lock "cinder-quobyte-0266a9c1-6ccd-48e2-91d5-b482c13af1a3" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:48 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-e2dd1f87-016c-4c0e-a105-882df6a73e57" returned: 0 in 0.270s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba34773f-a5c1-4273-8a63-11df350ec693]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-e2dd1f87-016c-4c0e-a105-882df6a73e57" released by "delete_volume" :: held 0.695s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Created reservations ['ef32390a-5038-48e0-bfcc-976c3aab193b', '0457d375-caf6-468c-821f-954b033f3830', '992124d8-478b-4a6a-8449-006d1f8caab6', '0f0f8541-21cc-4b73-b961-9a0656e8a227'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:48 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 Sep 01 01:58:48 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-56a8ab2b-3367-434a-bc07-011be790798a-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:48 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:48 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Lock "cinder-56a8ab2b-3367-434a-bc07-011be790798a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-56a8ab2b-3367-434a-bc07-011be790798a" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-56a8ab2b-3367-434a-bc07-011be790798a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot 56a8ab2b-3367-434a-bc07-011be790798a of volume 46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d074224-b06e-4af5-be94-6f73577ccc2c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:48 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a Sep 01 01:58:48 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-7dd7863e-9567-441c-86d2-63606fa45690-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:48 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:48 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:48 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Deleted volume successfully. Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3" returned: 0 in 0.478s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-7dd7863e-9567-441c-86d2-63606fa45690-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:48 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3 Sep 01 01:58:48 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "cinder-quobyte-7dd7863e-9567-441c-86d2-63606fa45690" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dea26c4f-bc2b-4912-b61a-ece17e05e27c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-e2dd1f87-016c-4c0e-a105-882df6a73e57-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-7dd7863e-9567-441c-86d2-63606fa45690" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0387cbbb-b6dd-4fe0-83b5-dc5b84fe157e]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:49 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 Sep 01 01:58:49 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:49 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a" returned: 0 in 0.439s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:49 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0266a9c1-6ccd-48e2-91d5-b482c13af1a3" returned: 0 in 0.292s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[484ab212-3c91-471b-8b53-853b11776ad5]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Lock "cinder-quobyte-0266a9c1-6ccd-48e2-91d5-b482c13af1a3" released by "delete_volume" :: held 0.818s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Created reservations ['12bd3fb5-959f-4925-a369-2b78362da4bc', 'cdf3c433-39fd-4484-8ede-c6bd9f6ccd0c', 'c87bdf90-7249-4872-8de9-84cd77912881', '434a6f8f-1dd8-4a6c-842b-f7a31b0b0b08'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:49 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 Sep 01 01:58:49 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:49 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:49 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:49 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690" returned: 0 in 0.394s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:49 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690 Sep 01 01:58:49 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:49 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Deleted volume successfully. Sep 01 01:58:49 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" returned: 0 in 0.493s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-d9221f48-7e83-4ac7-b5dd-df2396bdd6eb tempest-VolumeImageDependencyTests-1478761293 None] Lock "cinder-0266a9c1-6ccd-48e2-91d5-b482c13af1a3-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:49 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a Sep 01 01:58:49 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:49 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-7dd7863e-9567-441c-86d2-63606fa45690" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-quobyte-7dd7863e-9567-441c-86d2-63606fa45690" released by "delete_volume" :: held 0.828s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Created reservations ['6b072e7f-ebf8-4235-98c8-9d4f36a369a1', '38550228-763e-4308-8634-301a6509dd3f', 'f54cf850-b093-4393-935c-afed4dbf8a15', '359db834-4605-4011-ab63-3d51da250c50'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:49 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:49 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:50 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a" returned: 0 in 0.468s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:50 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a Sep 01 01:58:50 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:50 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Deleted volume successfully. Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cdd7f8b1-e953-4eba-adf1-495fdaebf98c tempest-SnapshotDependencyTests-1986129716 None] Lock "cinder-7dd7863e-9567-441c-86d2-63606fa45690-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:50 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8.56a8ab2b-3367-434a-bc07-011be790798a" returned: 0 in 0.323s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-56a8ab2b-3367-434a-bc07-011be790798a" released by "_delete_snapshot" :: held 1.850s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" released by "delete_snapshot" :: held 1.880s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Created reservations ['98cbd717-18f7-4348-9092-b1131e98cb7b', '7312ae17-c471-4d7b-b868-4c37f7a001c0', '97fb4a7e-856e-4f4d-90dd-a38522847c52', 'd99ca929-8114-46af-8cb1-f122e0f1b7af'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:50 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0b90b75a-253a-4628-a360-d62c01127371 tempest-ProjectMemberTests-671459076 None] Lock "cinder-56a8ab2b-3367-434a-bc07-011be790798a-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Lock "cinder-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[f574dd9c-dd09-466e-a8ac-e454a347605d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:50 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:51 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 Sep 01 01:58:51 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:51 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" returned: 0 in 0.424s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:51 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8 Sep 01 01:58:51 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:51 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" returned: 0 in 0.291s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8" released by "delete_volume" :: held 0.790s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Created reservations ['09ee7dc4-cef7-4386-af03-34d325abb001', '0fc302aa-c677-4058-a30c-9e7f78f56b79', 'f8621c24-085f-42d3-9cee-2d8fa41a3db4', 'ae307b8d-5651-400c-8628-b467bd64c394'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:51 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:51 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:58:51 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:52 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.315s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:52 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b3fb97fe-5841-42be-8f57-c9ff075baaf0 tempest-ProjectMemberTests-671459076 None] Lock "cinder-46b98f9d-8e29-4e0c-8f05-d663f7b7e7c8-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (3514e8ad-66dc-4f05-aee3-ca55c993dda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30630d2-e573-4dde-9a6c-0aef545181f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30630d2-e573-4dde-9a6c-0aef545181f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915976642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb28006-4d53-4a56-a83a-3ed0c14d78b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:52Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe81c527-db7a-4077-94f4-742727bcecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe81c527-db7a-4077-94f4-742727bcecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78cba00-224f-495d-9849-c2b029fdd883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78cba00-224f-495d-9849-c2b029fdd883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb28006-4d53-4a56-a83a-3ed0c14d78b1', 'volume_name': 'volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baad963a-9b4b-4841-810d-fa4c7f2d3115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baad963a-9b4b-4841-810d-fa4c7f2d3115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea191982-5315-469d-af20-5c8fbdf9bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:52 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Volume 6cb28006-4d53-4a56-a83a-3ed0c14d78b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1', 'volume_size': 1} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-915976642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb28006-4d53-4a56-a83a-3ed0c14d78b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:58:52Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Creating volume 6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:58:52 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:58:52 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:52 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 1073741824 Sep 01 01:58:52 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:53 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 1073741824" returned: 0 in 0.559s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:53 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 Sep 01 01:58:53 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:53 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e97ff58d-0114-495a-97d5-427126c75db1 tempest-ProjectAdminTests-1557843890 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0979270935059, 'free_capacity_gb': 1774.0979270935059, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87212) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea191982-5315-469d-af20-5c8fbdf9bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5877e318-962c-4b8e-a5fb-85d6cfc725c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:58:53 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Volume volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 (6cb28006-4d53-4a56-a83a-3ed0c14d78b1): created successfully Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5877e318-962c-4b8e-a5fb-85d6cfc725c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:58:53 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (3514e8ad-66dc-4f05-aee3-ca55c993dda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:58:53 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5011e68a-f6b4-42ff-b0d4-bc42ae4e734d tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:58:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:58:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:58:54 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Creating offline snapshot e0063681-4b8f-4468-9acb-e8e69a044800 of volume 6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:58:54 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b93c5b-db83-4d83-9e56-6c52f5239e73]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:54 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:55 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 Sep 01 01:58:55 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:55 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" returned: 0 in 0.469s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:55 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 1G Sep 01 01:58:55 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:55 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 1G" returned: 0 in 0.561s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:55 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:55 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 Sep 01 01:58:55 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:56 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:56 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 is being set with open permissions: ugo+rw Sep 01 01:58:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:56 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 Sep 01 01:58:56 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:56 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800" returned: 0 in 0.271s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:56 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.info Sep 01 01:58:56 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:56 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.info" returned: 0 in 0.271s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:56 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.info is being set with open permissions: ugo+rw Sep 01 01:58:56 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:56 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.info Sep 01 01:58:56 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:57 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.info" returned: 0 in 0.274s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:57 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:58:57 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e47e6d1b-4267-4241-917a-04cf2bbac84e tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:58:57 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-e0063681-4b8f-4468-9acb-e8e69a044800-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Lock "cinder-e0063681-4b8f-4468-9acb-e8e69a044800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-e0063681-4b8f-4468-9acb-e8e69a044800" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-e0063681-4b8f-4468-9acb-e8e69a044800" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot e0063681-4b8f-4468-9acb-e8e69a044800 of volume 6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[49048f02-e84e-4bba-b76a-37ceb90c3c54]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:58 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 Sep 01 01:58:58 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:58 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800" returned: 0 in 0.411s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb5bad0-9451-4e3b-801b-c3142fb17fd2]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:58 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 Sep 01 01:58:58 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:58 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" returned: 0 in 0.385s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:58 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 Sep 01 01:58:58 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:59 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800" returned: 0 in 0.466s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:59 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800 Sep 01 01:58:59 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:59 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1.e0063681-4b8f-4468-9acb-e8e69a044800" returned: 0 in 0.331s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-e0063681-4b8f-4468-9acb-e8e69a044800" released by "_delete_snapshot" :: held 1.723s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" released by "delete_snapshot" :: held 1.770s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:58:59 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Created reservations ['d13cb1b0-01e4-464d-a2ab-b5879d6803cb', '0b93849b-6c15-4f94-9c19-f523ffedc7a1', '55b07ea9-0800-41a6-9f4d-4b51c114c429', 'b79779eb-0138-4f9d-b448-da6e681a1ddb'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:58:59 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:58:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-29a6d1a8-677c-4cb5-ab10-379274fb3d4d tempest-ProjectMemberTests-671459076 None] Lock "cinder-e0063681-4b8f-4468-9acb-e8e69a044800-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-6cb28006-4d53-4a56-a83a-3ed0c14d78b1-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-6cb28006-4d53-4a56-a83a-3ed0c14d78b1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b558d168-7717-4544-956a-3670df01992f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:00 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 Sep 01 01:59:00 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:00 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" returned: 0 in 0.472s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:00 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1 Sep 01 01:59:00 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:01 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" returned: 0 in 0.284s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-6cb28006-4d53-4a56-a83a-3ed0c14d78b1" released by "delete_volume" :: held 0.846s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Created reservations ['d115a50e-c3ce-4896-b095-cb8415b5537a', 'd2e0533e-ba1f-4633-a371-c6f5b286ba7c', '3dcdc5b8-cf4a-4753-8b96-59524ee6c832', 'd7c4949b-abb6-49f0-b37b-89c5745d85db'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:01 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:01 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:01 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:59:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-916a70ef-551d-4795-a18d-5c93bd7dcea9 tempest-ProjectMemberTests-671459076 None] Lock "cinder-6cb28006-4d53-4a56-a83a-3ed0c14d78b1-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (84d97b9f-642c-4d86-b113-b62481b677de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5342fbd9-71b8-4da8-bbb6-96e1ffd22684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5342fbd9-71b8-4da8-bbb6-96e1ffd22684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939843418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74398084-d2a8-4350-ad14-ca9ed3b4acad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:02Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f7047-83e6-42be-a53c-7dd56837c8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f7047-83e6-42be-a53c-7dd56837c8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8c8797-7d58-4172-9154-1adf434e111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8c8797-7d58-4172-9154-1adf434e111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74398084-d2a8-4350-ad14-ca9ed3b4acad', 'volume_name': 'volume-74398084-d2a8-4350-ad14-ca9ed3b4acad', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c4d544-19ce-4b58-bcf9-eff9bee246a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c4d544-19ce-4b58-bcf9-eff9bee246a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87eb4d6-4586-4219-b74f-4cb1e96b2c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:02 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Volume 74398084-d2a8-4350-ad14-ca9ed3b4acad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74398084-d2a8-4350-ad14-ca9ed3b4acad', 'volume_size': 1} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1939843418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74398084-d2a8-4350-ad14-ca9ed3b4acad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:02Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Creating volume 74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:02 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:02 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad 1073741824 Sep 01 01:59:02 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:02 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad 1073741824" returned: 0 in 0.513s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:02 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad Sep 01 01:59:02 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:02 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad" returned: 0 in 0.273s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87eb4d6-4586-4219-b74f-4cb1e96b2c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74398084-d2a8-4350-ad14-ca9ed3b4acad', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80846fa-d6d3-4ea7-af66-8a369b7e07fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:02 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Volume volume-74398084-d2a8-4350-ad14-ca9ed3b4acad (74398084-d2a8-4350-ad14-ca9ed3b4acad): created successfully Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80846fa-d6d3-4ea7-af66-8a369b7e07fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:02 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (84d97b9f-642c-4d86-b113-b62481b677de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:03 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6bcedcb5-61ea-4257-a361-8e7d483519cf tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (16257377-f6b0-4e83-b760-1b51475c7d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84314d2-cb3c-4ce1-8d84-53d87f7f2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84314d2-cb3c-4ce1-8d84-53d87f7f2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579816375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214a175d-8f02-4c5c-968f-bd0bd96d4d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:03Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd712113-e8d7-4a1f-b244-29364e3c2f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd712113-e8d7-4a1f-b244-29364e3c2f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59eadb-1e77-40a0-b3c0-a823e6186c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e59eadb-1e77-40a0-b3c0-a823e6186c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214a175d-8f02-4c5c-968f-bd0bd96d4d05', 'volume_name': 'volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456b7d29-d913-4c9e-8b77-07826fc7e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456b7d29-d913-4c9e-8b77-07826fc7e40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedafbf6-0951-4af1-900e-d7bbd9660b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:03 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Volume 214a175d-8f02-4c5c-968f-bd0bd96d4d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05', 'volume_size': 1} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579816375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214a175d-8f02-4c5c-968f-bd0bd96d4d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:03Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Creating volume 214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:03 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:03 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 1073741824 Sep 01 01:59:03 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:04 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 1073741824" returned: 0 in 0.445s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:04 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 Sep 01 01:59:04 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:04 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.059s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedafbf6-0951-4af1-900e-d7bbd9660b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568e1ae-818c-4d77-bbec-4d73dca9b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Creating offline snapshot 095cfcb5-aeb4-488b-a578-94e71db05711 of volume 74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:59:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Volume volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 (214a175d-8f02-4c5c-968f-bd0bd96d4d05): created successfully Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5568e1ae-818c-4d77-bbec-4d73dca9b63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (16257377-f6b0-4e83-b760-1b51475c7d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03f8ef6-2791-4407-a659-a119517ce788]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-919a29cd-bc93-4a7a-8589-71db852cebf4 tempest-ProjectReaderTests-208419074 None] Created volume successfully. Sep 01 01:59:04 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad Sep 01 01:59:04 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:04 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad" returned: 0 in 0.383s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:04 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 1G Sep 01 01:59:04 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:05 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 1G" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74398084-d2a8-4350-ad14-ca9ed3b4acad -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:05 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74398084-d2a8-4350-ad14-ca9ed3b4acad -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 Sep 01 01:59:05 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:05 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74398084-d2a8-4350-ad14-ca9ed3b4acad -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711" returned: 0 in 0.285s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:05 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 is being set with open permissions: ugo+rw Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:05 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 Sep 01 01:59:05 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:05 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:05 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.info Sep 01 01:59:05 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:05 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.info" returned: 0 in 0.243s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:05 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.info is being set with open permissions: ugo+rw Sep 01 01:59:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:06 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.info Sep 01 01:59:06 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:06 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.info" returned: 0 in 0.237s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.491s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Creating offline snapshot a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 of volume 214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:59:06 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f7e36459-c7cc-4c9f-abcc-bb18bdcfe707 tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[a465fa2d-39ef-4846-9b3b-9b97181354c9]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:06 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 Sep 01 01:59:06 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-095cfcb5-aeb4-488b-a578-94e71db05711-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Lock "cinder-095cfcb5-aeb4-488b-a578-94e71db05711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-74398084-d2a8-4350-ad14-ca9ed3b4acad" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-74398084-d2a8-4350-ad14-ca9ed3b4acad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-095cfcb5-aeb4-488b-a578-94e71db05711" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-095cfcb5-aeb4-488b-a578-94e71db05711" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot 095cfcb5-aeb4-488b-a578-94e71db05711 of volume 74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe116e-40ac-4bbe-b4ee-0f2fe7b5f8cc]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:06 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 Sep 01 01:59:06 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:06 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05" returned: 0 in 0.421s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:06 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 1G Sep 01 01:59:06 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:06 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711" returned: 0 in 0.405s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74398084-d2a8-4350-ad14-ca9ed3b4acad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[782d187c-adcf-43b1-8ff6-140eb5c3be10]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:07 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad Sep 01 01:59:07 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:07 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 1G" returned: 0 in 0.437s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:07 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 Sep 01 01:59:07 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:07 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad" returned: 0 in 0.368s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:07 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 Sep 01 01:59:07 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:07 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" returned: 0 in 0.305s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:07 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 is being set with open permissions: ugo+rw Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:07 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 Sep 01 01:59:07 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:07 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:07 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711" returned: 0 in 0.376s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:07 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711 Sep 01 01:59:07 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:07 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.info Sep 01 01:59:07 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:07 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad.095cfcb5-aeb4-488b-a578-94e71db05711" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:08 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.info" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:08 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.info is being set with open permissions: ugo+rw Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-095cfcb5-aeb4-488b-a578-94e71db05711" released by "_delete_snapshot" :: held 1.517s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-74398084-d2a8-4350-ad14-ca9ed3b4acad" released by "delete_snapshot" :: held 1.555s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:08 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.info Sep 01 01:59:08 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Created reservations ['e6b33cfb-6469-42e0-b6d9-71d78876e0dd', 'e1f342be-b4b8-4869-b673-1ddd398e7b41', 'd7ff8333-fe66-4f8b-9fec-26b1e077cf37', '5e95127b-7f2a-45ab-a667-202682ee4d40'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-f4d51e8a-177c-45b8-94b8-1b2147f5291f tempest-ProjectMemberTests-671459076 None] Lock "cinder-095cfcb5-aeb4-488b-a578-94e71db05711-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:08 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.info" returned: 0 in 0.257s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-89dbbadf-6e12-4ac4-b276-4fdd6e6bf325 tempest-ProjectReaderTests-208419074 None] Create snapshot completed successfully Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-74398084-d2a8-4350-ad14-ca9ed3b4acad-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-74398084-d2a8-4350-ad14-ca9ed3b4acad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-74398084-d2a8-4350-ad14-ca9ed3b4acad" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-74398084-d2a8-4350-ad14-ca9ed3b4acad" acquired by "delete_volume" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29815d6-db73-430c-b7d6-f4d5deb67d91]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:08 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad Sep 01 01:59:08 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:09 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad" returned: 0 in 0.408s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:09 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad Sep 01 01:59:09 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Lock "cinder-a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-214a175d-8f02-4c5c-968f-bd0bd96d4d05" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-214a175d-8f02-4c5c-968f-bd0bd96d4d05" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Deleting offline snapshot a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 of volume 214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] snapshot_file for this snap is: volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc3340f-94f0-4164-a0f4-4ac92216bb39]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:09 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 Sep 01 01:59:09 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:09 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-74398084-d2a8-4350-ad14-ca9ed3b4acad" returned: 0 in 0.244s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-74398084-d2a8-4350-ad14-ca9ed3b4acad" released by "delete_volume" :: held 0.714s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Created reservations ['cd14cd18-82ed-475d-a4f0-ba0b4b5e9bb3', '5cc771ee-b1ca-493a-aa86-80bc2afd55f8', '33b059be-7234-49b9-ba10-426a57f4a37f', '4c02a070-95ce-4dd3-87dd-740b7b68b8ae'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:09 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:09 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:09 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" returned: 0 in 0.378s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0bca6c-bdbd-4c5e-8b1f-8999f0228607]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:09 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.255s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:09 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 Sep 01 01:59:09 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:09 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:59:09 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-dc797ba5-a165-48ab-82bc-c59df59173e2 tempest-ProjectMemberTests-671459076 None] Lock "cinder-74398084-d2a8-4350-ad14-ca9ed3b4acad-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:10 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05" returned: 0 in 0.454s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:10 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 Sep 01 01:59:10 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (0c655d4e-a00e-45a8-b136-4e34e63021ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beeb96e7-4dfb-426c-8a59-a556f1f000ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beeb96e7-4dfb-426c-8a59-a556f1f000ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813258332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014d49e6-279a-4624-9aee-260dc08457d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:10Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddcbfe1-c3ed-4eb5-8ef3-fa477e7f0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddcbfe1-c3ed-4eb5-8ef3-fa477e7f0119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc39518-5bcf-4d0a-b334-fdd1fb1469d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc39518-5bcf-4d0a-b334-fdd1fb1469d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014d49e6-279a-4624-9aee-260dc08457d0', 'volume_name': 'volume-014d49e6-279a-4624-9aee-260dc08457d0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d65387-10f5-4f8c-b272-18640a2bdfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d65387-10f5-4f8c-b272-18640a2bdfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e827ae94-aa5e-4a64-95c8-b2d969452e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:10 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Volume 014d49e6-279a-4624-9aee-260dc08457d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014d49e6-279a-4624-9aee-260dc08457d0', 'volume_size': 1} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813258332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014d49e6-279a-4624-9aee-260dc08457d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afc089e5e84451199595bbb25558075',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:10Z,use_quota=True,user_id='2a0c12926e4944f2921c46ea26c43263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Creating volume 014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:10 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:10 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 1073741824 Sep 01 01:59:10 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:10 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" returned: 0 in 0.383s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:10 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6 Sep 01 01:59:10 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:10 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05.a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" returned: 0 in 0.249s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6" released by "_delete_snapshot" :: held 1.577s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-214a175d-8f02-4c5c-968f-bd0bd96d4d05" released by "delete_snapshot" :: held 1.606s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Created reservations ['b7b8ceff-6443-43f6-b8bc-3e7603e9c594', '6a1bf6fe-b2d4-4b96-ad89-d99b9a73f03a', 'bb3c0be9-fa25-4335-b784-66668b58b3c2', 'a37d7ac7-fcdb-4ecc-b7c4-ea473971d936'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:10 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Delete snapshot completed successfully. Sep 01 01:59:10 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-2967d9a6-adc3-4921-81c1-5db0694fb62c tempest-ProjectReaderTests-208419074 None] Lock "cinder-a12abada-7fe2-4cdf-bcb5-d29f0c32c9f6-delete_snapshot" released by "delete_snapshot" :: held 1.775s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 1073741824" returned: 0 in 0.521s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:10 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:11 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 Sep 01 01:59:11 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:11 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0" returned: 0 in 0.294s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e827ae94-aa5e-4a64-95c8-b2d969452e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014d49e6-279a-4624-9aee-260dc08457d0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458d3e8a-5bd8-4c53-ac05-248189cd2ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:11 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Volume volume-014d49e6-279a-4624-9aee-260dc08457d0 (014d49e6-279a-4624-9aee-260dc08457d0): created successfully Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458d3e8a-5bd8-4c53-ac05-248189cd2ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Flow 'volume_create_manager' (0c655d4e-a00e-45a8-b136-4e34e63021ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-214a175d-8f02-4c5c-968f-bd0bd96d4d05-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:11 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4ba18b54-2d11-4aad-b80a-9747fef481e6 tempest-ProjectMemberTests-671459076 None] Created volume successfully. Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Lock "cinder-214a175d-8f02-4c5c-968f-bd0bd96d4d05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-214a175d-8f02-4c5c-968f-bd0bd96d4d05" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-214a175d-8f02-4c5c-968f-bd0bd96d4d05" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6da623-e778-463c-9a73-a1dc0a162858]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:11 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 Sep 01 01:59:11 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:11 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05" returned: 0 in 0.420s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:11 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:11 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05 Sep 01 01:59:11 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:12 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-214a175d-8f02-4c5c-968f-bd0bd96d4d05" returned: 0 in 0.249s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-214a175d-8f02-4c5c-968f-bd0bd96d4d05" released by "delete_volume" :: held 0.727s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Created reservations ['45cc305c-1971-4016-a10d-976bde195c23', 'd4f45290-1d2d-45b8-a799-9a618ca9fcbb', '490d4223-e493-4333-bdd8-0e724f8191fd', '4e715a97-a0ec-4b9b-812f-fb91d521770e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:12 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:12 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:12 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.338s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:12 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Deleted volume successfully. Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Creating offline snapshot ad6d6305-b75b-4f55-b4ac-4ba737d7d14d of volume 014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca241de-1f33-4328-a2fd-0577910c2e57]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:12 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-e270fbf4-1dc8-468a-956a-5cd497c1dc2d tempest-ProjectReaderTests-208419074 None] Lock "cinder-214a175d-8f02-4c5c-968f-bd0bd96d4d05-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:12 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 Sep 01 01:59:12 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:13 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0" returned: 0 in 0.431s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:13 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d 1G Sep 01 01:59:13 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (9dc182e7-b184-46ab-b9dd-2e467e49ec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777e0724-f72b-405d-a26e-21f04dcf05dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777e0724-f72b-405d-a26e-21f04dcf05dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310619066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c293ec-ecd1-4574-9961-84f9cea12ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:13Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb70ff9-3594-4649-a0ba-f7e714bb5f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb70ff9-3594-4649-a0ba-f7e714bb5f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca34ff0-214d-4161-8e3a-ff2fe87a64aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca34ff0-214d-4161-8e3a-ff2fe87a64aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c293ec-ecd1-4574-9961-84f9cea12ea0', 'volume_name': 'volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b2bbb0-28e0-4506-96be-e87ca5638940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b2bbb0-28e0-4506-96be-e87ca5638940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edddd0a-5f21-4245-95f5-980e1da7fe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:13 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Volume f0c293ec-ecd1-4574-9961-84f9cea12ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0', 'volume_size': 1} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:13 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d 1G" returned: 0 in 0.438s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-014d49e6-279a-4624-9aee-260dc08457d0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:13 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-014d49e6-279a-4624-9aee-260dc08457d0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d Sep 01 01:59:13 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:13 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-014d49e6-279a-4624-9aee-260dc08457d0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" returned: 0 in 0.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:13 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d is being set with open permissions: ugo+rw Sep 01 01:59:13 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:13 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d Sep 01 01:59:13 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:14 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" returned: 0 in 0.273s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:14 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.info Sep 01 01:59:14 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:14 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.info" returned: 0 in 0.261s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:14 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.info is being set with open permissions: ugo+rw Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:14 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.info Sep 01 01:59:14 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:14 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.info" returned: 0 in 0.254s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1310619066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c293ec-ecd1-4574-9961-84f9cea12ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:13Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Creating volume f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:14 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:14 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:14 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 1073741824 Sep 01 01:59:14 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:14 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-ba1dcba1-5a5d-4d01-b698-1f3542174eae tempest-ProjectMemberTests-671459076 None] Create snapshot completed successfully Sep 01 01:59:15 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 1073741824" returned: 0 in 0.431s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:15 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 Sep 01 01:59:15 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:15 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edddd0a-5f21-4245-95f5-980e1da7fe89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db71282-c7dc-49fe-929a-870094c900ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:15 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Volume volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 (f0c293ec-ecd1-4574-9961-84f9cea12ea0): created successfully Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db71282-c7dc-49fe-929a-870094c900ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (9dc182e7-b184-46ab-b9dd-2e467e49ec65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:15 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b3458dd3-e677-4997-8c8b-abd31c179458 tempest-ProjectReaderTests-208419074 None] Created volume successfully. Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-ad6d6305-b75b-4f55-b4ac-4ba737d7d14d-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Lock "cinder-ad6d6305-b75b-4f55-b4ac-4ba737d7d14d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-014d49e6-279a-4624-9aee-260dc08457d0" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-014d49e6-279a-4624-9aee-260dc08457d0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Deleting offline snapshot ad6d6305-b75b-4f55-b4ac-4ba737d7d14d of volume 014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] snapshot_file for this snap is: volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c1b49-4ca9-4820-900a-88166164081b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:15 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:16 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d Sep 01 01:59:16 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:16 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" returned: 0 in 0.354s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-014d49e6-279a-4624-9aee-260dc08457d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba7fd25-a180-4e5c-9dc8-bc416a7f7e27]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:16 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 Sep 01 01:59:16 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Creating offline snapshot 866de313-c601-4c25-b84f-5de292f22025 of volume f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b51f6f-be1e-421f-94f2-01990992600f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:16 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 Sep 01 01:59:16 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:16 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0" returned: 0 in 0.448s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:16 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d Sep 01 01:59:16 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:16 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0" returned: 0 in 0.367s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:16 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:16 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 1G Sep 01 01:59:16 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:17 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:17 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:17 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" returned: 0 in 0.369s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:17 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d Sep 01 01:59:17 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:17 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 1G" returned: 0 in 0.459s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:17 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 Sep 01 01:59:17 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:17 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:59:17 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0.ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" returned: 0 in 0.269s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-ad6d6305-b75b-4f55-b4ac-4ba737d7d14d" released by "_delete_snapshot" :: held 1.535s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-014d49e6-279a-4624-9aee-260dc08457d0" released by "delete_snapshot" :: held 1.559s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Created reservations ['e243a97f-90d3-430f-a61c-d0226ce15f14', 'f764988c-5c13-4f8d-974b-16ade691966e', '3c2000ac-c81a-4e04-89ff-bf5ed693db82', 'f26a6111-27f2-48b8-99e5-3549673de9d9'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:17 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Delete snapshot completed successfully. Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-62113a16-9a7c-461a-941d-bf959c592d86 tempest-ProjectMemberTests-671459076 None] Lock "cinder-ad6d6305-b75b-4f55-b4ac-4ba737d7d14d-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:17 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025" returned: 0 in 0.303s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:17 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 is being set with open permissions: ugo+rw Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:17 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 Sep 01 01:59:17 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:17 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025" returned: 0 in 0.229s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:17 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.info Sep 01 01:59:17 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-014d49e6-279a-4624-9aee-260dc08457d0-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Lock "cinder-014d49e6-279a-4624-9aee-260dc08457d0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Acquiring lock "cinder-quobyte-014d49e6-279a-4624-9aee-260dc08457d0" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-014d49e6-279a-4624-9aee-260dc08457d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e9565a-b99c-430e-bc91-6153482b6118]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:18 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.info" returned: 0 in 0.264s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:18 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.info is being set with open permissions: ugo+rw Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:18 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.info Sep 01 01:59:18 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:18 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 Sep 01 01:59:18 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:18 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.info" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:18 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-10e72405-96dd-45f3-82f1-c5d17c72abb9 tempest-ProjectReaderTests-208419074 None] Create snapshot completed successfully Sep 01 01:59:18 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0" returned: 0 in 0.404s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:18 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0 Sep 01 01:59:18 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-866de313-c601-4c25-b84f-5de292f22025-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Lock "cinder-866de313-c601-4c25-b84f-5de292f22025-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-f0c293ec-ecd1-4574-9961-84f9cea12ea0" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-f0c293ec-ecd1-4574-9961-84f9cea12ea0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-866de313-c601-4c25-b84f-5de292f22025" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-866de313-c601-4c25-b84f-5de292f22025" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Deleting offline snapshot 866de313-c601-4c25-b84f-5de292f22025 of volume f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] snapshot_file for this snap is: volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f093e8-5c4d-43a3-a8f2-6b7f505471a7]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:18 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:18 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 Sep 01 01:59:18 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-014d49e6-279a-4624-9aee-260dc08457d0" returned: 0 in 0.280s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Lock "cinder-quobyte-014d49e6-279a-4624-9aee-260dc08457d0" released by "delete_volume" :: held 0.742s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Created reservations ['95404afe-5966-489c-a286-15d7d9c36b56', '0475868e-4509-49f4-8d50-bdaed4ce8d39', '36357121-9f40-4ed2-b03b-ce5f32ad31a4', '3d0eecf5-d2fa-4eb9-824a-653be16c71f9'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:18 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:19 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:19 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:19 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025" returned: 0 in 0.375s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620d2b5-50bd-4bf8-80a1-c9fef3451640]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:19 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 Sep 01 01:59:19 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:19 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.280s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:19 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Deleted volume successfully. Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-0bbdc527-b59b-4442-a202-f0b3a4f9e211 tempest-ProjectMemberTests-671459076 None] Lock "cinder-014d49e6-279a-4624-9aee-260dc08457d0-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:19 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0" returned: 0 in 0.379s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:19 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 Sep 01 01:59:19 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:19 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025" returned: 0 in 0.370s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:19 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:19 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025 Sep 01 01:59:19 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:20 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0.866de313-c601-4c25-b84f-5de292f22025" returned: 0 in 0.305s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-866de313-c601-4c25-b84f-5de292f22025" released by "_delete_snapshot" :: held 1.528s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-f0c293ec-ecd1-4574-9961-84f9cea12ea0" released by "delete_snapshot" :: held 1.559s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Created reservations ['6cc8b9ac-68ff-441d-ac9d-6d72d5c9a814', '506003f5-dbf8-46c2-931a-d2643e36849b', '6627269f-a3c1-4edf-8227-d65a0a6c89c0', 'caa06ad4-4d8f-4fb5-b715-4d47869792ae'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:20 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Delete snapshot completed successfully. Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-25efc77f-e7dd-4bb6-955c-dd0b4205b715 tempest-ProjectReaderTests-208419074 None] Lock "cinder-866de313-c601-4c25-b84f-5de292f22025-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-f0c293ec-ecd1-4574-9961-84f9cea12ea0-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Lock "cinder-f0c293ec-ecd1-4574-9961-84f9cea12ea0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-f0c293ec-ecd1-4574-9961-84f9cea12ea0" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-f0c293ec-ecd1-4574-9961-84f9cea12ea0" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213f456-d664-4894-978a-345bf5b7c4b6]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:20 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:21 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 Sep 01 01:59:21 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:21 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0" returned: 0 in 0.366s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:21 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0 Sep 01 01:59:21 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:21 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f0c293ec-ecd1-4574-9961-84f9cea12ea0" returned: 0 in 0.289s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-f0c293ec-ecd1-4574-9961-84f9cea12ea0" released by "delete_volume" :: held 0.724s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Created reservations ['bb42f332-a348-4456-a5b9-4b2f19b0a3a2', 'afe31e87-ed4e-4ddb-b68f-a7578994de0a', '982afce6-7765-4ebb-9640-3921b679fea6', '66e9ae97-d05f-4747-b176-2cdc75f5001e'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:21 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:21 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:21 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:22 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:22 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Deleted volume successfully. Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-882367ec-783e-4b65-bc0e-cb08a08d9cfd tempest-ProjectReaderTests-208419074 None] Lock "cinder-f0c293ec-ecd1-4574-9961-84f9cea12ea0-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (a6f2016d-660f-4a2d-accd-b6b8faf3f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b58cf4f-7526-4d41-bef6-6e15ce95ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b58cf4f-7526-4d41-bef6-6e15ce95ce22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032959654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844dbc90-a56b-4cd2-b387-91c64303e406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:22Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d6b858-b79e-4d1d-a589-13c4ef9c5dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d6b858-b79e-4d1d-a589-13c4ef9c5dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ec8aa2-73f2-4f6d-a37e-8a5598d32855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ec8aa2-73f2-4f6d-a37e-8a5598d32855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844dbc90-a56b-4cd2-b387-91c64303e406', 'volume_name': 'volume-844dbc90-a56b-4cd2-b387-91c64303e406', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7104ff-6a45-4395-8743-98704fccac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7104ff-6a45-4395-8743-98704fccac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b649fd8-272c-4abc-beb2-694c706720f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:22 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Volume 844dbc90-a56b-4cd2-b387-91c64303e406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844dbc90-a56b-4cd2-b387-91c64303e406', 'volume_size': 1} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032959654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844dbc90-a56b-4cd2-b387-91c64303e406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:22Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Creating volume 844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:22 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:22 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:22 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 1073741824 Sep 01 01:59:22 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:23 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 1073741824" returned: 0 in 0.469s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 Sep 01 01:59:23 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:23 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406" returned: 0 in 0.252s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b649fd8-272c-4abc-beb2-694c706720f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844dbc90-a56b-4cd2-b387-91c64303e406', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2ca08d-895e-492f-a436-5aea2842a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:23 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Volume volume-844dbc90-a56b-4cd2-b387-91c64303e406 (844dbc90-a56b-4cd2-b387-91c64303e406): created successfully Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2ca08d-895e-492f-a436-5aea2842a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:23 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (a6f2016d-660f-4a2d-accd-b6b8faf3f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:23 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-e49806b0-8faa-46c3-ac39-f83f05a5ec91 tempest-ProjectReaderTests-208419074 None] Created volume successfully. Sep 01 01:59:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:24 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Creating offline snapshot ec4269e3-f3df-4f75-adc2-9335d4420c41 of volume 844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:59:24 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaa1fca-956b-421e-b43b-49920aa5c3b5]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:24 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:24 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 Sep 01 01:59:24 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:25 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406" returned: 0 in 0.426s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:25 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 1G Sep 01 01:59:25 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:25 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 1G" returned: 0 in 0.508s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:25 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844dbc90-a56b-4cd2-b387-91c64303e406 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:25 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844dbc90-a56b-4cd2-b387-91c64303e406 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 Sep 01 01:59:25 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:26 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844dbc90-a56b-4cd2-b387-91c64303e406 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41" returned: 0 in 0.293s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:26 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 is being set with open permissions: ugo+rw Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:26 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 Sep 01 01:59:26 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:26 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41" returned: 0 in 0.256s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=190,cinder:INSERT=57,cinder:UPDATE=226,cinder:DELETE=16 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=159,cinder:INSERT=72,cinder:UPDATE=221,cinder:DELETE=19 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:26 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.info Sep 01 01:59:26 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:26 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.info" returned: 0 in 0.295s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:26 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.info is being set with open permissions: ugo+rw Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:26 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.info Sep 01 01:59:26 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:26 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.info" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:26 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:27 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-1097db02-710d-4d46-8f99-1d7f7864fc89 tempest-ProjectReaderTests-208419074 None] Create snapshot completed successfully Sep 01 01:59:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-ec4269e3-f3df-4f75-adc2-9335d4420c41-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Lock "cinder-ec4269e3-f3df-4f75-adc2-9335d4420c41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-844dbc90-a56b-4cd2-b387-91c64303e406" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-844dbc90-a56b-4cd2-b387-91c64303e406" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:27 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-ec4269e3-f3df-4f75-adc2-9335d4420c41" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-ec4269e3-f3df-4f75-adc2-9335d4420c41" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Deleting offline snapshot ec4269e3-f3df-4f75-adc2-9335d4420c41 of volume 844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] snapshot_file for this snap is: volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[7534da36-359c-4968-a4ae-a823116df8ee]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:28 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 Sep 01 01:59:28 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:28 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41" returned: 0 in 0.385s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-844dbc90-a56b-4cd2-b387-91c64303e406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab796153-2854-4d84-b8b7-90d7826dea6f]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:28 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 Sep 01 01:59:28 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:28 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406" returned: 0 in 0.444s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:28 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:28 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 Sep 01 01:59:28 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:29 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41" returned: 0 in 0.401s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:29 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41 Sep 01 01:59:29 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:29 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:29 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406.ec4269e3-f3df-4f75-adc2-9335d4420c41" returned: 0 in 0.260s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-ec4269e3-f3df-4f75-adc2-9335d4420c41" released by "_delete_snapshot" :: held 1.586s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-844dbc90-a56b-4cd2-b387-91c64303e406" released by "delete_snapshot" :: held 1.614s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:29 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Created reservations ['a9ff6070-a1b3-4a21-ae2d-01c53d3247b2', 'd7c079c2-0dc8-44ef-80dd-c2d7e3fc3afe', '8ab183a2-de56-4aa3-8788-47fc4726bfb1', 'c11ee40e-7b0e-4ef2-a0bb-e068935ddc32'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:29 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Delete snapshot completed successfully. Sep 01 01:59:29 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b8827639-015e-4a43-adcc-f8baac81f009 tempest-ProjectReaderTests-208419074 None] Lock "cinder-ec4269e3-f3df-4f75-adc2-9335d4420c41-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-844dbc90-a56b-4cd2-b387-91c64303e406-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Lock "cinder-844dbc90-a56b-4cd2-b387-91c64303e406-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-844dbc90-a56b-4cd2-b387-91c64303e406" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-844dbc90-a56b-4cd2-b387-91c64303e406" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0be1e1f-f2bb-454f-a711-2715464148f9]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:30 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 Sep 01 01:59:30 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:30 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406" returned: 0 in 0.416s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:30 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406 Sep 01 01:59:30 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:30 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:30 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-844dbc90-a56b-4cd2-b387-91c64303e406" returned: 0 in 0.289s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-844dbc90-a56b-4cd2-b387-91c64303e406" released by "delete_volume" :: held 0.773s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Created reservations ['2eab6a96-14fe-4260-b0b6-504a671617c5', '703c5a3b-ed1d-4744-a722-2cf8f209bd49', '00246fc7-5212-4011-abbf-bd98618af5bd', 'f9ec4de5-17b6-491d-8a7a-28bc0c838390'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:31 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:31 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:31 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.261s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:31 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Deleted volume successfully. Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-4a42aac6-98a2-4ee3-951f-2a5b8df48d90 tempest-ProjectReaderTests-208419074 None] Lock "cinder-844dbc90-a56b-4cd2-b387-91c64303e406-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (48256609-2f32-44d9-b5fd-0a9ee200867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e09228b-b06d-4511-84b3-6ac6ad5dae13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e09228b-b06d-4511-84b3-6ac6ad5dae13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968012960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d126c37-2647-43a3-9b45-5fda99679519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:32Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce1b42b-5495-4909-982c-60a91a254765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce1b42b-5495-4909-982c-60a91a254765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494eab55-4ed4-4cd2-a8af-e0583d2e7fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494eab55-4ed4-4cd2-a8af-e0583d2e7fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d126c37-2647-43a3-9b45-5fda99679519', 'volume_name': 'volume-0d126c37-2647-43a3-9b45-5fda99679519', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330d1b24-fd5d-481a-8cc9-e6e9e80d8f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330d1b24-fd5d-481a-8cc9-e6e9e80d8f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1b7db6-974f-4aa3-b4c8-a86a62b77bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:31 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Volume 0d126c37-2647-43a3-9b45-5fda99679519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d126c37-2647-43a3-9b45-5fda99679519', 'volume_size': 1} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1968012960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d126c37-2647-43a3-9b45-5fda99679519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:32Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Creating volume 0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:31 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:31 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:32 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 1073741824 Sep 01 01:59:32 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:32 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 1073741824" returned: 0 in 0.475s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:32 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 Sep 01 01:59:32 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:32 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519" returned: 0 in 0.286s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1b7db6-974f-4aa3-b4c8-a86a62b77bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d126c37-2647-43a3-9b45-5fda99679519', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20032f75-ec18-4b3b-8efb-39941a4b8c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:32 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Volume volume-0d126c37-2647-43a3-9b45-5fda99679519 (0d126c37-2647-43a3-9b45-5fda99679519): created successfully Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20032f75-ec18-4b3b-8efb-39941a4b8c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:32 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (48256609-2f32-44d9-b5fd-0a9ee200867f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:32 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6e8a0b3d-cbae-453d-bac4-bde4880aacdb tempest-ProjectReaderTests-208419074 None] Created volume successfully. Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Flow 'volume_create_manager' (39994208-3828-4cd9-b8a5-6b47951315ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c5f3f8-008f-4560-b607-c30c56684581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c5f3f8-008f-4560-b607-c30c56684581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488787045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e99327-f5df-4b3e-8276-6ad9f215109d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c4c09c878242f5aaa34930723bcdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:33Z,use_quota=True,user_id='8fa44615f23445aba2efe32eec555ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430497df-a66b-4deb-a9fa-a657ca75435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430497df-a66b-4deb-a9fa-a657ca75435d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4886b7-61ea-487b-a18f-812630860e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4886b7-61ea-487b-a18f-812630860e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e99327-f5df-4b3e-8276-6ad9f215109d', 'volume_name': 'volume-b4e99327-f5df-4b3e-8276-6ad9f215109d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3586e771-58fd-4bd1-abab-e8b99f5c9135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3586e771-58fd-4bd1-abab-e8b99f5c9135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768630b5-cd84-45c4-ba3b-6b253d8c5b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Volume b4e99327-f5df-4b3e-8276-6ad9f215109d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e99327-f5df-4b3e-8276-6ad9f215109d', 'volume_size': 1} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488787045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e99327-f5df-4b3e-8276-6ad9f215109d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c4c09c878242f5aaa34930723bcdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:33Z,use_quota=True,user_id='8fa44615f23445aba2efe32eec555ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Creating volume b4e99327-f5df-4b3e-8276-6ad9f215109d {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:33 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:33 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d 1073741824 Sep 01 01:59:33 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:33 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d 1073741824" returned: 0 in 0.446s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:33 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d Sep 01 01:59:33 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:33 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d" returned: 0 in 0.250s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768630b5-cd84-45c4-ba3b-6b253d8c5b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e99327-f5df-4b3e-8276-6ad9f215109d', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b38ea9f-7fed-4763-a221-c7864616b24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:33 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Volume volume-b4e99327-f5df-4b3e-8276-6ad9f215109d (b4e99327-f5df-4b3e-8276-6ad9f215109d): created successfully Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b38ea9f-7fed-4763-a221-c7864616b24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:33 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Flow 'volume_create_manager' (39994208-3828-4cd9-b8a5-6b47951315ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:33 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-5d87b5b2-0442-459c-9601-1f4ce31f2548 tempest-ProjectReaderTests-187331858 None] Created volume successfully. Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Creating offline snapshot c36676f6-b1e9-46d0-af2c-d24037d533ca of volume 0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5506ad6-66cd-4588-a3fd-981fbff25426]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Acquiring lock "cinder-b4e99327-f5df-4b3e-8276-6ad9f215109d-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:34 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 Sep 01 01:59:34 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Lock "cinder-b4e99327-f5df-4b3e-8276-6ad9f215109d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Acquiring lock "cinder-quobyte-b4e99327-f5df-4b3e-8276-6ad9f215109d" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Lock "cinder-quobyte-b4e99327-f5df-4b3e-8276-6ad9f215109d" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[5304818c-58e9-400f-a1de-4cf506a81a84]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:34 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d Sep 01 01:59:34 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:34 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519" returned: 0 in 0.374s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:34 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca 1G Sep 01 01:59:34 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:34 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d" returned: 0 in 0.406s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:34 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d Sep 01 01:59:34 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:34 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca 1G" returned: 0 in 0.399s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:34 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d126c37-2647-43a3-9b45-5fda99679519 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:34 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d126c37-2647-43a3-9b45-5fda99679519 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca Sep 01 01:59:34 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:35 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b4e99327-f5df-4b3e-8276-6ad9f215109d" returned: 0 in 0.294s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Lock "cinder-quobyte-b4e99327-f5df-4b3e-8276-6ad9f215109d" released by "delete_volume" :: held 0.746s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Created reservations ['71afa39b-04a1-4a87-8c68-9e7d9fc3fc5b', 'e9db1119-5050-49d4-bf9b-770f0cb76b8d', 'e54647a2-4d47-47f5-843b-9191801e7758', 'dfb80502-4ca4-4148-acf7-45d60d90dc4c'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d126c37-2647-43a3-9b45-5fda99679519 -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca" returned: 0 in 0.317s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:35 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca is being set with open permissions: ugo+rw Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:35 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:35 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca Sep 01 01:59:35 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:35 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:35 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Deleted volume successfully. Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-83fc858f-1b94-4063-ba73-9ccb026f59c3 tempest-ProjectReaderTests-187331858 None] Lock "cinder-b4e99327-f5df-4b3e-8276-6ad9f215109d-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:35 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca" returned: 0 in 0.307s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.info Sep 01 01:59:35 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:35 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.info" returned: 0 in 0.294s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:35 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.info is being set with open permissions: ugo+rw Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.info Sep 01 01:59:35 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Flow 'volume_create_manager' (a108f375-0f24-4a54-92a5-e0fa9b80c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:35 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596be801-ecb1-47e6-862f-c7e2f35668df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596be801-ecb1-47e6-862f-c7e2f35668df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703102388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67427c0-e812-4838-94bc-a5082aa86cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c4c09c878242f5aaa34930723bcdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:36Z,use_quota=True,user_id='8fa44615f23445aba2efe32eec555ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65a94b1-e8ae-4d45-af98-ad710a70e055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65a94b1-e8ae-4d45-af98-ad710a70e055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b88d3b-8138-40d7-a46c-0bc0a939634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b88d3b-8138-40d7-a46c-0bc0a939634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67427c0-e812-4838-94bc-a5082aa86cf5', 'volume_name': 'volume-f67427c0-e812-4838-94bc-a5082aa86cf5', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18155b1e-19b5-4c0d-a44a-68ffcc2fe2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18155b1e-19b5-4c0d-a44a-68ffcc2fe2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda98780-22c3-4f74-9bee-60f3b7fca32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Volume f67427c0-e812-4838-94bc-a5082aa86cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67427c0-e812-4838-94bc-a5082aa86cf5', 'volume_size': 1} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:36 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.info" returned: 0 in 0.253s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703102388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67427c0-e812-4838-94bc-a5082aa86cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c4c09c878242f5aaa34930723bcdd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:36Z,use_quota=True,user_id='8fa44615f23445aba2efe32eec555ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Creating volume f67427c0-e812-4838-94bc-a5082aa86cf5 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:36 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:36 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 1073741824 Sep 01 01:59:36 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-f0f68c4d-132a-4c34-b05e-e13031704a1c tempest-ProjectReaderTests-208419074 None] Create snapshot completed successfully Sep 01 01:59:36 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 1073741824" returned: 0 in 0.416s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:36 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 Sep 01 01:59:36 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5" returned: 0 in 0.289s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda98780-22c3-4f74-9bee-60f3b7fca32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67427c0-e812-4838-94bc-a5082aa86cf5', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e526860-8897-4e47-85ed-da447d0117b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:36 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Volume volume-f67427c0-e812-4838-94bc-a5082aa86cf5 (f67427c0-e812-4838-94bc-a5082aa86cf5): created successfully Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e526860-8897-4e47-85ed-da447d0117b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:36 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Flow 'volume_create_manager' (a108f375-0f24-4a54-92a5-e0fa9b80c59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:36 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-0991524e-2f36-47cc-a75d-02e3649172ba tempest-ProjectReaderTests-187331858 None] Created volume successfully. Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-c36676f6-b1e9-46d0-af2c-d24037d533ca-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Lock "cinder-c36676f6-b1e9-46d0-af2c-d24037d533ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-0d126c37-2647-43a3-9b45-5fda99679519" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-0d126c37-2647-43a3-9b45-5fda99679519" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-c36676f6-b1e9-46d0-af2c-d24037d533ca" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-c36676f6-b1e9-46d0-af2c-d24037d533ca" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Deleting offline snapshot c36676f6-b1e9-46d0-af2c-d24037d533ca of volume 0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] snapshot_file for this snap is: volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e04cce-da98-4b28-89d5-a01f42568434]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:37 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca Sep 01 01:59:37 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:37 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca" returned: 0 in 0.359s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d126c37-2647-43a3-9b45-5fda99679519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629b59a-9d47-4472-b15b-f2aa10943be5]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:37 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:37 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 Sep 01 01:59:37 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Acquiring lock "cinder-f67427c0-e812-4838-94bc-a5082aa86cf5-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Lock "cinder-f67427c0-e812-4838-94bc-a5082aa86cf5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Acquiring lock "cinder-quobyte-f67427c0-e812-4838-94bc-a5082aa86cf5" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:38 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519" returned: 0 in 0.415s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:38 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca Sep 01 01:59:38 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Lock "cinder-quobyte-f67427c0-e812-4838-94bc-a5082aa86cf5" acquired by "delete_volume" :: waited 0.034s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db1809a-8c83-4633-aa61-cc99dcf3894c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:38 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 Sep 01 01:59:38 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:38 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca" returned: 0 in 0.360s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:38 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca Sep 01 01:59:38 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:38 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5" returned: 0 in 0.415s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:38 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5 Sep 01 01:59:38 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:38 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519.c36676f6-b1e9-46d0-af2c-d24037d533ca" returned: 0 in 0.301s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-c36676f6-b1e9-46d0-af2c-d24037d533ca" released by "_delete_snapshot" :: held 1.533s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-0d126c37-2647-43a3-9b45-5fda99679519" released by "delete_snapshot" :: held 1.557s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:38 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:38 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-f67427c0-e812-4838-94bc-a5082aa86cf5" returned: 0 in 0.306s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Created reservations ['c7dd8f60-9c9e-4cf5-9d64-ed2147f71c90', '6f54f980-d040-47a7-ae4d-4e289590aa58', 'efe297f5-266b-4349-8889-a0fa3539f24b', '2e7ab886-21d5-4bfc-9ee3-75baae61f6c3'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Lock "cinder-quobyte-f67427c0-e812-4838-94bc-a5082aa86cf5" released by "delete_volume" :: held 0.771s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Delete snapshot completed successfully. Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-b2d1ed9e-3324-42b2-b70b-d9606b739078 tempest-ProjectReaderTests-208419074 None] Lock "cinder-c36676f6-b1e9-46d0-af2c-d24037d533ca-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Created reservations ['87394e33-1469-409c-a0e0-b5c7b9d8673e', '445d9417-24f9-4f09-871c-b7138e95478d', '6dba3d7e-192d-49a9-8b49-997cff3b567f', '5062567f-3307-42b4-b505-14a8f2028a30'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:39 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:39 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:39 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.255s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:39 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Deleted volume successfully. Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-579237ce-1da1-4a78-a98e-6df4458f1eb0 tempest-ProjectReaderTests-187331858 None] Lock "cinder-f67427c0-e812-4838-94bc-a5082aa86cf5-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-0d126c37-2647-43a3-9b45-5fda99679519-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Lock "cinder-0d126c37-2647-43a3-9b45-5fda99679519-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-0d126c37-2647-43a3-9b45-5fda99679519" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-0d126c37-2647-43a3-9b45-5fda99679519" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[46507b33-313d-4ea4-a7a7-83c8a9c66d1c]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:39 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:39 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 Sep 01 01:59:39 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:40 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519" returned: 0 in 0.387s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:40 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519 Sep 01 01:59:40 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:40 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-0d126c37-2647-43a3-9b45-5fda99679519" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-0d126c37-2647-43a3-9b45-5fda99679519" released by "delete_volume" :: held 0.720s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Created reservations ['8c44c304-a6b0-41a5-ac5f-256b0a8a5467', 'afcac438-a1d0-41c0-9152-e5745bec049d', 'ebad7670-2b1a-4977-821e-d6138e685e2b', '4fb9dbe1-a6d7-437d-872b-417011a0b594'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:40 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:40 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:40 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:40 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Deleted volume successfully. Sep 01 01:59:40 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-a989468f-0faf-43ff-bcc9-0f765c23c822 tempest-ProjectReaderTests-208419074 None] Lock "cinder-0d126c37-2647-43a3-9b45-5fda99679519-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (e221d453-dadf-4c9a-b801-a4046306d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b149c5d-e719-42ca-bf5f-d1b950471f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b149c5d-e719-42ca-bf5f-d1b950471f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855377781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:41Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5a5bdc-c391-4ce3-88ec-1363435d7075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5a5bdc-c391-4ce3-88ec-1363435d7075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148bb089-143a-49a0-bb7e-2e2eeded15fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148bb089-143a-49a0-bb7e-2e2eeded15fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b', 'volume_name': 'volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3907e9-da21-4c7a-9a32-5744ef6a4112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3907e9-da21-4c7a-9a32-5744ef6a4112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e3b357-f316-423b-99c7-babe67ed3a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:41 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Volume b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b', 'volume_size': 1} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855377781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e226bd61e7418e9a664377668a8c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:41Z,use_quota=True,user_id='7a47cc93d4ca4cfb91154f1eb3cbf3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Creating volume b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:41 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:41 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b 1073741824 Sep 01 01:59:41 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:41 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b 1073741824" returned: 0 in 0.451s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:41 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:41 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b Sep 01 01:59:41 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:42 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" returned: 0 in 0.259s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e3b357-f316-423b-99c7-babe67ed3a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0b8c60-ec75-495b-b3ff-16afc262c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:42 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Volume volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b (b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b): created successfully Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0b8c60-ec75-495b-b3ff-16afc262c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Flow 'volume_create_manager' (e221d453-dadf-4c9a-b801-a4046306d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:42 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-bd92bd1b-1fcc-4da3-8318-cc5faaada160 tempest-ProjectReaderTests-208419074 None] Created volume successfully. Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Creating offline snapshot 24ce3ed1-c4d9-43fd-8a51-eabdeec24714 of volume b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[92604b5d-0b6a-4648-87cc-ce06677ce20b]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:42 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b Sep 01 01:59:42 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:42 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" returned: 0 in 0.387s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:42 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 1G {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:42 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 1G Sep 01 01:59:42 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:43 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 1G" returned: 0 in 0.419s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:43 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 Sep 01 01:59:43 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:43 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b -F qcow2 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714" returned: 0 in 0.313s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:43 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 is being set with open permissions: ugo+rw Sep 01 01:59:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:43 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 Sep 01 01:59:43 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:43 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:43 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:43 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.info Sep 01 01:59:43 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:44 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.info" returned: 0 in 0.278s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:44 devstack cinder-volume[87212]: WARNING cinder.volume.drivers.remotefs [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.info is being set with open permissions: ugo+rw Sep 01 01:59:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.info {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:44 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.info Sep 01 01:59:44 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:44 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.info" returned: 0 in 0.263s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:44 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:44 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-b619c136-0243-43b5-a3a0-dfe69ae8a52a tempest-ProjectReaderTests-208419074 None] Create snapshot completed successfully Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-24ce3ed1-c4d9-43fd-8a51-eabdeec24714-delete_snapshot" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Lock "cinder-24ce3ed1-c4d9-43fd-8a51-eabdeec24714-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" by "delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-24ce3ed1-c4d9-43fd-8a51-eabdeec24714" by "_delete_snapshot" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-24ce3ed1-c4d9-43fd-8a51-eabdeec24714" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Deleting offline snapshot 24ce3ed1-c4d9-43fd-8a51-eabdeec24714 of volume b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] snapshot_file for this snap is: volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 {{(pid=87212) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad7fe1b-6337-49b7-b8c6-8e5a463f8d74]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:45 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:45 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 Sep 01 01:59:45 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:46 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714" returned: 0 in 0.400s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87212) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ccfe4-b893-4d2e-b102-91e4e38d9949]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:46 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b Sep 01 01:59:46 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:46 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" returned: 0 in 0.386s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:46 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 Sep 01 01:59:46 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:46 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714" returned: 0 in 0.396s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:46 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:46 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714 Sep 01 01:59:46 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:47 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b.24ce3ed1-c4d9-43fd-8a51-eabdeec24714" returned: 0 in 0.290s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-24ce3ed1-c4d9-43fd-8a51-eabdeec24714" released by "_delete_snapshot" :: held 1.590s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" released by "delete_snapshot" :: held 1.629s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Created reservations ['2dd7ec95-f52d-49db-ae9e-bf40d17515da', 'd39d13be-333f-45c6-a3cd-2bfc763ebb2b', '76e9d088-0ad0-478c-8cf1-7d6d726e5a95', 'b5c8d80f-e68d-4f9e-9966-c2dcd3dc80cf'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:47 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Delete snapshot completed successfully. Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-19fd079c-acf8-406c-b7b1-454cf858d411 tempest-ProjectReaderTests-208419074 None] Lock "cinder-24ce3ed1-c4d9-43fd-8a51-eabdeec24714-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Lock "cinder-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Acquiring lock "cinder-quobyte-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" acquired by "delete_volume" :: waited 0.017s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c1fe69-c2a0-4a95-8291-5d83091b0a9d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:47 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:48 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b Sep 01 01:59:48 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:48 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" returned: 0 in 0.367s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:48 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b Sep 01 01:59:48 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:48 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" returned: 0 in 0.274s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Lock "cinder-quobyte-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b" released by "delete_volume" :: held 0.704s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Created reservations ['3c9518e5-6817-405b-bf59-b73370dc1b92', '213021a7-10e9-4f96-b026-ee3f05d74662', '3608f22d-a777-4482-8069-61e5de4af86c', '71343db1-ef1a-451c-ab68-8718a6aa1bed'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:48 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:48 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:48 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:49 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:49 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.294s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:49 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:49 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Deleted volume successfully. Sep 01 01:59:49 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-592fb84a-bc92-463c-8140-4dd522651301 tempest-ProjectReaderTests-208419074 None] Lock "cinder-b08de8d4-f7a0-48bb-8a06-1dcf46b6ba7b-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:57 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 01:59:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (8c91e11a-30cf-4fe1-a517-6b765aa87a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:57 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d30a9b-f9f2-47b8-9031-ef4af815f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d30a9b-f9f2-47b8-9031-ef4af815f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2061105213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:58Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c493d5-905b-4b44-923c-065d0a208101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c493d5-905b-4b44-923c-065d0a208101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4d1545-eafb-4005-b70a-ea51ba0a32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4d1545-eafb-4005-b70a-ea51ba0a32fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9', 'volume_name': 'volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f21c01b-5fec-4423-a817-9daf76f23c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f21c01b-5fec-4423-a817-9daf76f23c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4161496-874d-4eb1-9e69-3e00bad927b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:58 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Volume 4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9', 'volume_size': 1} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-31T23:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2061105213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-31T23:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-31T23:59:58Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Creating volume 4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 01:59:58 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:58 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 1073741824 Sep 01 01:59:58 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:58 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 1073741824" returned: 0 in 0.417s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:58 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 Sep 01 01:59:58 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:58 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9" returned: 0 in 0.258s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4161496-874d-4eb1-9e69-3e00bad927b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc966d8-dba0-45a2-9f3c-755a829e4141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 01:59:58 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Volume volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 (4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9): created successfully Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc966d8-dba0-45a2-9f3c-755a829e4141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 01:59:58 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (8c91e11a-30cf-4fe1-a517-6b765aa87a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 01:59:58 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-6ac8352a-2337-4013-a0ab-a44a9376af68 tempest-ProjectReaderTests-505108668 None] Created volume successfully. Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Lock "cinder-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-quobyte-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9" acquired by "delete_volume" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c9c91-b40b-460b-aadb-f055a9383781]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:59 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 Sep 01 01:59:59 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:59 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9" returned: 0 in 0.367s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:59 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9 Sep 01 01:59:59 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:59 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9" returned: 0 in 0.273s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9" released by "delete_volume" :: held 0.675s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Created reservations ['bdf7e10a-cf77-439a-8a99-c543ff1d2673', '4b72348b-c94a-4b47-8cfb-084188d37fad', 'd88d9e8c-e400-4123-9fa2-e9b08e1d2b68', '42d2f433-065e-44cf-8b78-9ef6506c0a40'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:59 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:59 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 01:59:59 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:00 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.266s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:00 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Deleted volume successfully. Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-cb57b9cd-6d18-4005-ba68-5009cad79551 tempest-ProjectReaderTests-505108668 None] Lock "cinder-4f043d21-ad96-4fcd-a4ad-8ab46cab3fa9-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (68e75cb4-c4c7-413a-890e-550bdb35e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ce5517-9aac-4fc3-9a81-acd1fd9faed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ce5517-9aac-4fc3-9a81-acd1fd9faed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734009812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3f678e-3018-42db-b3a8-e3145a37c043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:01Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1679677-2303-40c1-9e7e-302740feff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1679677-2303-40c1-9e7e-302740feff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88889464-abe0-488f-a9d2-fa26b7c7a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88889464-abe0-488f-a9d2-fa26b7c7a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea3f678e-3018-42db-b3a8-e3145a37c043', 'volume_name': 'volume-ea3f678e-3018-42db-b3a8-e3145a37c043', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e0bfa3-1f55-4f6f-ab6f-be1c8f33cfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e0bfa3-1f55-4f6f-ab6f-be1c8f33cfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e0517a-4a61-44e8-87e8-1583d0d0edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:00 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Volume ea3f678e-3018-42db-b3a8-e3145a37c043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea3f678e-3018-42db-b3a8-e3145a37c043', 'volume_size': 1} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734009812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea3f678e-3018-42db-b3a8-e3145a37c043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:01Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Creating volume ea3f678e-3018-42db-b3a8-e3145a37c043 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:00 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 02:00:00 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:00 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 1073741824 Sep 01 02:00:00 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:01 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 1073741824" returned: 0 in 0.432s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:01 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 Sep 01 02:00:01 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:01 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043" returned: 0 in 0.272s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e0517a-4a61-44e8-87e8-1583d0d0edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea3f678e-3018-42db-b3a8-e3145a37c043', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092cf08-8e6a-47e6-bc12-752535ba71ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:01 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Volume volume-ea3f678e-3018-42db-b3a8-e3145a37c043 (ea3f678e-3018-42db-b3a8-e3145a37c043): created successfully Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092cf08-8e6a-47e6-bc12-752535ba71ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (68e75cb4-c4c7-413a-890e-550bdb35e813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:01 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-a6d55290-6e09-4c8a-8b52-23865d63a8d5 tempest-ProjectReaderTests-505108668 None] Created volume successfully. Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-ea3f678e-3018-42db-b3a8-e3145a37c043-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Lock "cinder-ea3f678e-3018-42db-b3a8-e3145a37c043-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-quobyte-ea3f678e-3018-42db-b3a8-e3145a37c043" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-ea3f678e-3018-42db-b3a8-e3145a37c043" acquired by "delete_volume" :: waited 0.014s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[2905e054-11a2-4828-8545-61808e809c0d]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:01 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:02 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 Sep 01 02:00:02 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:02 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043" returned: 0 in 0.356s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:02 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043 Sep 01 02:00:02 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:02 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-ea3f678e-3018-42db-b3a8-e3145a37c043" returned: 0 in 0.277s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-ea3f678e-3018-42db-b3a8-e3145a37c043" released by "delete_volume" :: held 0.673s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Created reservations ['925c44de-c4c2-4d8f-b28d-dcbafb7a33c5', '549f15c5-9b36-4ad0-96e2-3c16e4b13ee0', '79c7b750-0ef3-4fad-a1d6-dc8d5d2dd0e7', 'e7430b9d-7188-4f2f-b603-e81fbc4c7929'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:02 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 02:00:02 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:02 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.281s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:02 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:03 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Deleted volume successfully. Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-7a47914d-d817-45ed-956f-e5bfc64be283 tempest-ProjectReaderTests-505108668 None] Lock "cinder-ea3f678e-3018-42db-b3a8-e3145a37c043-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (15c5f36f-5bd3-4ff6-aa7e-7f0bfad898da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6425ef2c-23df-47e0-8449-8ed8bdd8d941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6425ef2c-23df-47e0-8449-8ed8bdd8d941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988919090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cd5179-62de-400d-802c-c46f1b2b47d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:03Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e766921a-c517-439d-83c3-71a156ef3ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e766921a-c517-439d-83c3-71a156ef3ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17452eb4-6b8b-43d0-bff4-e9b0c977e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17452eb4-6b8b-43d0-bff4-e9b0c977e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50cd5179-62de-400d-802c-c46f1b2b47d9', 'volume_name': 'volume-50cd5179-62de-400d-802c-c46f1b2b47d9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669cde80-35c5-4d74-94f1-802ef78acbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669cde80-35c5-4d74-94f1-802ef78acbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04998926-7383-4c30-82f1-e661c2c56866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:03 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Volume 50cd5179-62de-400d-802c-c46f1b2b47d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50cd5179-62de-400d-802c-c46f1b2b47d9', 'volume_size': 1} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988919090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50cd5179-62de-400d-802c-c46f1b2b47d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:03Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Creating volume 50cd5179-62de-400d-802c-c46f1b2b47d9 {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:03 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 02:00:03 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:03 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 1073741824 Sep 01 02:00:03 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:04 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 1073741824" returned: 0 in 0.437s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:04 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 Sep 01 02:00:04 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:04 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9" returned: 0 in 0.234s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04998926-7383-4c30-82f1-e661c2c56866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50cd5179-62de-400d-802c-c46f1b2b47d9', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25caa89-05d0-4a25-8d08-c1592da91f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:04 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Volume volume-50cd5179-62de-400d-802c-c46f1b2b47d9 (50cd5179-62de-400d-802c-c46f1b2b47d9): created successfully Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25caa89-05d0-4a25-8d08-c1592da91f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (15c5f36f-5bd3-4ff6-aa7e-7f0bfad898da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:04 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-9d1aecee-bcdb-4010-a469-7247d20d0652 tempest-ProjectReaderTests-505108668 None] Created volume successfully. Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-50cd5179-62de-400d-802c-c46f1b2b47d9-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Lock "cinder-50cd5179-62de-400d-802c-c46f1b2b47d9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-quobyte-50cd5179-62de-400d-802c-c46f1b2b47d9" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-50cd5179-62de-400d-802c-c46f1b2b47d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfc5e35-f341-44fe-bc37-b85fa60f7724]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:04 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:04 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 Sep 01 02:00:04 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:05 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9" returned: 0 in 0.370s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:05 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9 Sep 01 02:00:05 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:05 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-50cd5179-62de-400d-802c-c46f1b2b47d9" returned: 0 in 0.267s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-50cd5179-62de-400d-802c-c46f1b2b47d9" released by "delete_volume" :: held 0.679s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Created reservations ['adbc6398-8005-4983-881b-ec91f89adb47', '92d5762c-c1fc-41c7-a44c-7ae7ec22c99c', '0258fc01-dc31-47a9-a9c2-b4c0ff161aff', 'e171b2a1-6d16-4e48-8f7b-7634e83aa7cd'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:05 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 02:00:05 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:05 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.304s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:05 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Deleted volume successfully. Sep 01 02:00:05 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-8c44e54a-c9f2-46f2-92f3-37a168c1850b tempest-ProjectReaderTests-505108668 None] Lock "cinder-50cd5179-62de-400d-802c-c46f1b2b47d9-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.flows.manager.create_volume [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87212) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (1ce8bba0-1a17-4a4a-837a-0078d4160909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3d05f2-ebd2-4f46-9668-93cb47052b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3d05f2-ebd2-4f46-9668-93cb47052b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097412679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305f5eb7-3f43-4ceb-a438-a30cce83bffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:06Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85a37d3-12cd-468c-a4b0-e70024eb0303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85a37d3-12cd-468c-a4b0-e70024eb0303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb187f1-a239-4ad7-bc81-7ad8dfecd572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb187f1-a239-4ad7-bc81-7ad8dfecd572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305f5eb7-3f43-4ceb-a438-a30cce83bffd', 'volume_name': 'volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7612482-294f-456e-a176-cea98b4d0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7612482-294f-456e-a176-cea98b4d0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e40aab5-f1c2-413f-a872-c1c68857e2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:06 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Volume 305f5eb7-3f43-4ceb-a438-a30cce83bffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd', 'volume_size': 1} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097412679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305f5eb7-3f43-4ceb-a438-a30cce83bffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efae0296d1674c32a5b652f6c5e2e261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:06Z,use_quota=True,user_id='2f6b78c8c0794fecbeca0f6f1c520387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b3c90d-95e3-4d06-9c9f-9c6cd59603c9),volume_type_id=89b3c90d-95e3-4d06-9c9f-9c6cd59603c9)}" {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.remotefs [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Creating volume 305f5eb7-3f43-4ceb-a438-a30cce83bffd {{(pid=87212) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Selected osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 as target Quobyte volume. {{(pid=87212) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:06 devstack cinder-volume[87212]: INFO cinder.volume.drivers.remotefs [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] casted to osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1 Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd 1073741824 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:06 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd 1073741824 Sep 01 02:00:06 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:06 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd 1073741824" returned: 0 in 0.408s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:06 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:06 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd Sep 01 02:00:06 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:07 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd" returned: 0 in 0.257s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'} {{(pid=87212) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e40aab5-f1c2-413f-a872-c1c68857e2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd', 'volume_size': 1}' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10db696e-7f73-4811-a036-c40fa1400407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:07 devstack cinder-volume[87212]: INFO cinder.volume.flows.manager.create_volume [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Volume volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd (305f5eb7-3f43-4ceb-a438-a30cce83bffd): created successfully Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10db696e-7f73-4811-a036-c40fa1400407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87212) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Flow 'volume_create_manager' (1ce8bba0-1a17-4a4a-837a-0078d4160909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87212) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:07 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-74403229-1abf-4918-80d3-8e2be7045773 tempest-ProjectReaderTests-505108668 None] Created volume successfully. Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-305f5eb7-3f43-4ceb-a438-a30cce83bffd-delete_volume" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Lock "cinder-305f5eb7-3f43-4ceb-a438-a30cce83bffd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Acquiring lock "cinder-quobyte-305f5eb7-3f43-4ceb-a438-a30cce83bffd" by "delete_volume" {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-305f5eb7-3f43-4ceb-a438-a30cce83bffd" acquired by "delete_volume" :: waited 0.016s {{(pid=87212) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG oslo.privsep.daemon [-] privsep: reply[74662325-73b7-4253-bebe-10c9c9c2542a]: (4, 'qcow2') {{(pid=88472) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:07 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd Sep 01 02:00:07 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:07 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd" returned: 0 in 0.339s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:07 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd Sep 01 02:00:07 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:07 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1/volume-305f5eb7-3f43-4ceb-a438-a30cce83bffd" returned: 0 in 0.238s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:07 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Lock "cinder-quobyte-305f5eb7-3f43-4ceb-a438-a30cce83bffd" released by "delete_volume" :: held 0.620s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG cinder.quota [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Created reservations ['7339dbef-413e-4859-85bb-6b86f15266e1', '90621267-d4eb-4a3a-bb4a-3669dc3ef9cc', '8d7bd767-b6e1-4ab2-9905-a1efbac967d1', '9971924d-2959-4c8b-8e00-3be2d0fbf4e2'] {{(pid=87212) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:08 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 02:00:08 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:08 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.237s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:08 devstack cinder-volume[87212]: INFO cinder.volume.manager [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Deleted volume successfully. Sep 01 02:00:08 devstack cinder-volume[87212]: DEBUG cinder.coordination [None req-3c66b238-f585-41d9-9931-243c2c55ea9e tempest-ProjectReaderTests-505108668 None] Lock "cinder-305f5eb7-3f43-4ceb-a438-a30cce83bffd-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87212) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1': None} {{(pid=87212) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG cinder.volume.drivers.quobyte [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2f34a89a-4c63-4c7c-95bf-150fee38a7d1'] {{(pid=87212) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.lockutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87212) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:17 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1 Sep 01 02:00:17 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:17 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG oslo_concurrency.processutils [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b12893a57d9264d840e771541475c4a1" returned: 0 in 0.282s {{(pid=87212) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG cinder.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Notifying Schedulers of capabilities ... {{(pid=87212) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG oslo_service.periodic_task [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] Running periodic task VolumeManager._thread_info {{(pid=87212) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread count: 29 {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:00:17 devstack cinder-volume[87212]: DEBUG cinder.volume.manager [None req-16359cc6-ce78-4b95-8356-fcc45feb4471 None None] thread info: [<_MainThread(MainThread, started 129002308509824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87212) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:00:18 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:UPDATE=120,cinder:SELECT=82,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:18 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=79,cinder:INSERT=31,cinder:DELETE=12,cinder:UPDATE=112 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:36 devstack cinder-volume[87212]: DEBUG dbcounter [-] [87212] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87212) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}